Jun 11 15:13:38.817216 ip-10-0-133-2 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 15:13:38.817227 ip-10-0-133-2 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 15:13:38.817234 ip-10-0-133-2 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 15:13:38.817439 ip-10-0-133-2 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 15:13:48.941366 ip-10-0-133-2 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 15:13:48.941386 ip-10-0-133-2 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e9c911f24d8143bbaf8a1c36e16e9975 -- Jun 11 15:16:36.494638 ip-10-0-133-2 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:16:36.907437 ip-10-0-133-2 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:16:36.907437 ip-10-0-133-2 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:16:36.907437 ip-10-0-133-2 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:16:36.907437 ip-10-0-133-2 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:16:36.907437 ip-10-0-133-2 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:16:36.909398 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.909308 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:16:36.914478 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914459 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.914478 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914477 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.914478 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914481 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914485 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914488 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914491 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914494 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914499 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914503 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914506 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914509 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914511 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914514 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914517 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914520 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914523 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914525 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914528 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914530 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914533 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914539 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914543 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.914578 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914545 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914548 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914551 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914554 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914556 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914558 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914562 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914564 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914567 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914569 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914572 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914575 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914577 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914580 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914582 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914585 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914588 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914591 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914593 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914596 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.915089 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914599 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914601 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914603 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914606 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914609 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914611 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914614 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914617 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914619 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914623 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914625 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914628 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914631 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914633 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914637 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914639 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914642 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914645 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914647 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914650 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.915606 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914652 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914655 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914657 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914660 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914662 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914665 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914668 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914670 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914673 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914675 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914678 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914680 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914683 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914685 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914688 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914690 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914693 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914695 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914698 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914700 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.916093 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914703 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914706 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914710 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914713 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914717 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914721 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914724 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914727 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914731 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914734 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914737 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914740 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914742 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914745 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914747 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914750 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.914753 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915483 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.916681 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915490 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915493 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915495 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915498 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915501 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915506 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915510 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915513 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915516 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915520 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915522 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915525 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915528 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915531 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915534 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915537 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915540 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915543 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915546 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.917111 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915549 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915553 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915556 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915559 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915562 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915565 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915568 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915570 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915573 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915576 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915579 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915581 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915584 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915586 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915589 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915591 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915594 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915597 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915599 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915602 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.917645 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915604 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915607 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915609 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915612 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915615 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915619 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915622 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915624 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915627 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915630 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915632 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915635 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915638 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915641 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915644 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915646 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915649 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915651 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915654 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915656 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.918139 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915659 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915661 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915664 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915666 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915669 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915672 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915675 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915677 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915680 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915682 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915686 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915690 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915692 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915695 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915697 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915700 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915702 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915705 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915708 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915711 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.918639 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915714 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915716 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915719 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915721 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915724 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915728 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915731 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915734 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915736 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915739 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915741 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915744 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915746 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915749 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915752 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915755 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915757 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915759 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.915762 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916238 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.919118 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916251 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916256 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916261 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916264 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916268 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916271 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916274 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916277 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916282 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916284 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916287 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916290 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916292 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916295 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916298 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916300 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916303 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916306 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916308 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.919625 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916311 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916313 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916316 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916318 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916321 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916323 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916326 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916328 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916332 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916336 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916338 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916341 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916344 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916348 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916350 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916353 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916355 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916358 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916360 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916363 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.920090 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916366 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916368 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916371 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916374 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916376 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916379 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916381 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916384 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916387 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916389 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916391 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916394 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916396 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916399 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916402 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916405 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916407 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916410 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916413 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.920629 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916415 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916418 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916420 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916423 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916425 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916428 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916431 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916434 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916437 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916439 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916441 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916445 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916448 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916451 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916453 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916456 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916459 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916461 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916464 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916466 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.921092 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916469 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916471 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916474 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916477 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916479 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916482 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916484 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916487 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916489 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916492 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916495 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916498 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916502 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916504 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916507 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916510 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916513 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916515 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916519 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.916521 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.921597 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916605 2582 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916616 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916626 2582 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916631 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916635 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916639 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916644 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916648 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916651 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916655 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916659 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916663 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916666 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916669 2582 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916672 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916675 2582 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916678 2582 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916681 2582 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916684 2582 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916687 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916690 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916694 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916697 2582 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916701 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:16:36.922102 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916704 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916707 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916711 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916714 2582 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916717 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916720 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916725 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916728 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916733 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916736 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916739 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916742 2582 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916745 2582 flags.go:64] FLAG: --enable-server="true" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916748 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916752 2582 flags.go:64] FLAG: --event-burst="100" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916755 2582 flags.go:64] FLAG: --event-qps="50" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916757 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916760 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916764 2582 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916768 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916771 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916774 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916776 2582 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916779 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916782 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:16:36.922714 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916786 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916789 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916791 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916794 2582 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916797 2582 flags.go:64] FLAG: --feature-gates="" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916801 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916808 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916811 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916814 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916817 2582 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916820 2582 flags.go:64] FLAG: --help="false" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916823 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-133-2.ec2.internal" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916826 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916832 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916835 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916838 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916842 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916844 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916847 2582 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916850 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916853 2582 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916856 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916859 2582 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916862 2582 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:16:36.923369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916865 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916867 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916871 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916874 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916877 2582 flags.go:64] FLAG: --lock-file="" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916879 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916882 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916885 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916890 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916893 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916896 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916898 2582 flags.go:64] FLAG: --logging-format="text" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916901 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916904 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916907 2582 flags.go:64] FLAG: --manifest-url="" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916910 2582 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916914 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916917 2582 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916921 2582 flags.go:64] FLAG: --max-pods="110" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916924 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916927 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916931 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916934 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916937 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916940 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:16:36.923972 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916943 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916955 2582 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916958 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916961 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916964 2582 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916967 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916972 2582 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916975 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916979 2582 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916981 2582 flags.go:64] FLAG: --port="10250" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916985 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916988 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c9b395854ea974a" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916991 2582 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916994 2582 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.916997 2582 flags.go:64] FLAG: --register-node="true" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917000 2582 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917004 2582 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917007 2582 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917010 2582 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917013 2582 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917016 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917019 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917023 2582 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917025 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917028 2582 flags.go:64] FLAG: --runonce="false" Jun 11 15:16:36.924984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917031 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917034 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917037 2582 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917041 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917044 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917047 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917050 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917053 2582 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917056 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917059 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917062 2582 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917064 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917068 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917070 2582 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917073 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917079 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917082 2582 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917085 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917089 2582 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917092 2582 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917095 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917098 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917101 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917103 2582 flags.go:64] FLAG: --v="2" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917108 2582 flags.go:64] FLAG: --version="false" Jun 11 15:16:36.925846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917112 2582 flags.go:64] FLAG: --vmodule="" Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917115 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.917119 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917253 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917257 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917260 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917264 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917266 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917271 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917274 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917279 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917282 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917285 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917287 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917290 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917293 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917297 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917300 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917303 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.926519 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917306 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917309 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917311 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917314 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917317 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917320 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917323 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917326 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917329 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917332 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917335 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917339 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917341 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917344 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917346 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917349 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917351 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917354 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917356 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.926988 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917359 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917361 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917364 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917366 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917373 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917378 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917381 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917384 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917386 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917389 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917391 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917394 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917397 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917399 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917402 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917404 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917406 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917409 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917412 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.927486 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917415 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917418 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917421 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917423 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917426 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917428 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917431 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917434 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917436 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917439 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917441 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917444 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917446 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917449 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917452 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917454 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917457 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917460 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917464 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917467 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.927953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917469 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917472 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917474 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917477 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917479 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917482 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917484 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917486 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917489 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917491 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917494 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917496 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917499 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917502 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917504 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917508 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917510 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917513 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917515 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917518 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.928466 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917520 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917523 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917525 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917528 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.917530 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.918237 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.927384 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.927405 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.928181 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.928192 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928274 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928281 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928284 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928287 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928291 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.928952 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928294 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928297 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928300 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928302 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928305 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928308 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928310 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928313 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928316 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928318 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928321 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928323 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928326 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928329 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928332 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928334 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928337 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928339 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928342 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.929345 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928345 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928349 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928353 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928356 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928360 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928363 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928366 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928369 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928371 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928374 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928377 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928379 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928382 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928385 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928387 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928390 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928393 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928395 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928398 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928400 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.929814 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928403 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928405 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928409 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928412 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928414 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928417 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928420 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928422 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928425 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928427 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928429 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928432 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928434 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928437 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928439 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928442 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928445 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928448 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928451 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928454 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.930318 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928457 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928459 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928462 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928464 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928467 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928470 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928473 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928475 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928478 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928480 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928483 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928486 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928488 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928491 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928493 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928496 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928499 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928503 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928506 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.930836 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928510 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928513 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928516 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928520 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928522 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928525 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928528 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928530 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928533 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928536 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928538 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928541 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928544 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928546 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928549 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.931322 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928551 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.928556 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928701 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928706 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928709 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928711 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928715 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928717 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928720 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928723 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928725 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928728 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928731 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928734 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928737 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:16:36.931690 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928740 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928742 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928745 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928747 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928750 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928752 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928755 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928758 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928760 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928763 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928766 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928770 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928772 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928776 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928780 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928783 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928786 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928789 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928791 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:16:36.932065 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928795 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928798 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928801 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928804 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928807 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928809 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928812 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928815 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928817 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928819 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928822 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928825 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928827 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928830 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928833 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928835 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928838 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928841 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928843 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:16:36.932538 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928845 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928848 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928851 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928854 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928856 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928859 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928861 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928864 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928867 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928869 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928872 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928874 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928877 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928879 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928882 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928884 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928887 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928889 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928892 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928894 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:16:36.932991 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928897 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928899 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928902 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928904 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928907 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928910 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928912 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928916 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928918 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928921 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928923 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928926 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928928 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928930 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928933 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928936 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928938 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928941 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928944 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928946 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:16:36.933727 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928949 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928951 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928954 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928957 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928960 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928962 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928966 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:36.928970 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.928975 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.929106 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.931362 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.933022 2582 server.go:1019] "Starting client certificate rotation" Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.933127 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:16:36.934218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.933171 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:16:36.936087 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.936068 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:16:36.937461 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.937447 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:16:36.949531 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.949508 2582 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:16:36.952696 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.952681 2582 log.go:25] "Validated CRI v1 image API" Jun 11 15:16:36.953527 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.953509 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:16:36.956062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.956034 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bc5310c7-9d5a-4514-833e-c575457fbefa:/dev/nvme0n1p4 fd43b1e6-68e1-4bd4-beef-8844d4e8c1ab:/dev/nvme0n1p3] Jun 11 15:16:36.956122 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.956062 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:16:36.962346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.962204 2582 manager.go:216] Machine: {Timestamp:2026-06-11 15:16:36.960735528 +0000 UTC m=+0.345932917 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096379 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2537d6e4792d724894d35cd0b7f43a SystemUUID:ec2537d6-e479-2d72-4894-d35cd0b7f43a BootID:e9c911f2-4d81-43bb-af8a-1c36e16e9975 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:ed:19:80:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:ed:19:80:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:12:ce:b2:41:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:16:36.962346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.962332 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:16:36.962481 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.962425 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:16:36.963449 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.963423 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:16:36.963588 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.963452 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:16:36.964051 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.964041 2582 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:16:36.964081 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.964056 2582 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:16:36.964081 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.964066 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:16:36.964652 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.964641 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:16:36.965188 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.965171 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:16:36.965492 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.965480 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:16:36.968916 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.968903 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:16:36.969044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969034 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:16:36.969080 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969069 2582 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:16:36.969151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969092 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:16:36.969151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969111 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:16:36.969151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969124 2582 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:16:36.969151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969136 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:16:36.969518 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969507 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:16:36.969559 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.969527 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:16:36.972720 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.972704 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:16:36.974362 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.974348 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:16:36.974423 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.974379 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:16:36.975010 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975000 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:16:36.975041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975016 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:16:36.975041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975024 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:16:36.975041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975031 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:16:36.975146 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975042 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:16:36.975146 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975050 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:16:36.975373 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975362 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:16:36.975373 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975374 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:16:36.975429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975381 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:16:36.975429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975386 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:16:36.975429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975398 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:16:36.975429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.975406 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:16:36.976595 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.976581 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:16:36.976631 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.976599 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:16:36.979907 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.979888 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:16:36.979978 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.979908 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:16:36.979978 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.979904 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:16:36.980160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.980148 2582 server.go:1268] "Started kubelet" Jun 11 15:16:36.980303 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.980253 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:16:36.980398 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.980323 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:16:36.980398 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.980257 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:16:36.981117 ip-10-0-133-2 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:16:36.981727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.981519 2582 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:16:36.983634 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.983614 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:16:36.987594 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.986703 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-2.ec2.internal.18b80fc64c1fc480 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-2.ec2.internal,UID:ip-10-0-133-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-2.ec2.internal,},FirstTimestamp:2026-06-11 15:16:36.980122752 +0000 UTC m=+0.365320121,LastTimestamp:2026-06-11 15:16:36.980122752 +0000 UTC m=+0.365320121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-2.ec2.internal,}" Jun 11 15:16:36.987708 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.987691 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:16:36.990107 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990091 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:16:36.990284 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990187 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:16:36.990284 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.990185 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:36.990712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990688 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:16:36.990802 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990771 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:16:36.990802 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990788 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:16:36.990927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990909 2582 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:16:36.990998 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.990931 2582 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:16:36.991053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991045 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:16:36.991088 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991058 2582 factory.go:55] Registering systemd factory Jun 11 15:16:36.991088 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991068 2582 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:16:36.991469 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991446 2582 factory.go:153] Registering CRI-O factory Jun 11 15:16:36.991469 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991465 2582 factory.go:223] Registration of the crio container factory successfully Jun 11 15:16:36.991610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991489 2582 factory.go:103] Registering Raw factory Jun 11 15:16:36.991610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991502 2582 manager.go:1196] Started watching for new ooms in manager Jun 11 15:16:36.992023 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.991912 2582 manager.go:349] Starting recovery of all containers Jun 11 15:16:36.994413 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:36.994390 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlncl" Jun 11 15:16:36.994525 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.994386 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 15:16:36.994598 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:36.994491 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 15:16:37.002147 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.002117 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlncl" Jun 11 15:16:37.004760 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.004737 2582 manager.go:354] Recovery completed Jun 11 15:16:37.008861 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.008847 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.012557 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.012540 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.012613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.012573 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.012613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.012586 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.013050 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013036 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:16:37.013095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013052 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:16:37.013095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013058 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.013095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013072 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:16:37.013805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013789 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.013857 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013814 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.013857 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.013824 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.014172 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.014162 2582 policy_none.go:49] "None policy: Start" Jun 11 15:16:37.014207 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.014177 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:16:37.014207 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.014187 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:16:37.015131 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.015003 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-2.ec2.internal.18b80fc64e0ead0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-2.ec2.internal,UID:ip-10-0-133-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-2.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-2.ec2.internal,},FirstTimestamp:2026-06-11 15:16:37.012557068 +0000 UTC m=+0.397754437,LastTimestamp:2026-06-11 15:16:37.012557068 +0000 UTC m=+0.397754437,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-2.ec2.internal,}" Jun 11 15:16:37.015485 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.015471 2582 policy_none.go:47] "Start" Jun 11 15:16:37.056912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.056896 2582 manager.go:337] "Starting Device Plugin manager" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.056931 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.056940 2582 server.go:87] "Starting device plugin registration server" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.057243 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.057259 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.057344 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.057455 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.057466 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.058323 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:16:37.062142 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.058378 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.064449 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.064411 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:16:37.065745 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.065727 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:16:37.065819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.065763 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:16:37.065819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.065807 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:16:37.065915 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.065897 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:16:37.068139 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.068119 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:37.158196 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.158129 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.159171 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.159147 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.159314 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.159181 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.159314 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.159194 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.159314 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.159220 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.166285 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.166265 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal"] Jun 11 15:16:37.166340 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.166329 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.167172 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.167153 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.167261 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.167185 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.167261 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.167196 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.167682 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.167666 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.167734 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.167696 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-2.ec2.internal\": node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.168405 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.168392 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.168533 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.168504 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.168533 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.168534 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.169078 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169063 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.169165 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169102 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.169165 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169115 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.169294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169163 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.169294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169187 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.169294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.169205 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.170382 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.170367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.170469 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.170396 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:16:37.171023 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.171007 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:16:37.171091 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.171038 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:16:37.171091 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.171052 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:16:37.178428 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.178408 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.192309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.192287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.192400 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.192315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.192400 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.192331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ac02efbad501c753c36f4c24a72e8f4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-2.ec2.internal\" (UID: \"1ac02efbad501c753c36f4c24a72e8f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.196982 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.196965 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-2.ec2.internal\" not found" node="ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.201850 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.201836 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-2.ec2.internal\" not found" node="ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.279096 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.279065 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.292451 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.292515 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.292515 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ac02efbad501c753c36f4c24a72e8f4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-2.ec2.internal\" (UID: \"1ac02efbad501c753c36f4c24a72e8f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.292515 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292511 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ac02efbad501c753c36f4c24a72e8f4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-2.ec2.internal\" (UID: \"1ac02efbad501c753c36f4c24a72e8f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.292610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292429 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.292610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.292554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c22a57309b21bbb74b841d78061ce0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal\" (UID: \"b8c22a57309b21bbb74b841d78061ce0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.380097 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.380063 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.480983 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.480909 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.502366 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.502339 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.506719 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.506604 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:37.581307 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.581270 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.681900 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.681856 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.782449 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.782356 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.882935 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.882905 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:37.929087 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.929063 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:37.932197 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.932179 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:16:37.932332 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.932310 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:16:37.932369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:37.932352 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:16:37.983153 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:37.983084 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.004643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.004606 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 15:11:36 +0000 UTC" deadline="2027-12-31 23:09:25.54700823 +0000 UTC" Jun 11 15:16:38.004643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.004637 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13639h52m47.542373713s" Jun 11 15:16:38.042179 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:38.042116 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac02efbad501c753c36f4c24a72e8f4.slice/crio-0e46310f622a4580ce19651197c050dc45b2162490c92fdbb5794f0cbe5b9494 WatchSource:0}: Error finding container 0e46310f622a4580ce19651197c050dc45b2162490c92fdbb5794f0cbe5b9494: Status 404 returned error can't find the container with id 0e46310f622a4580ce19651197c050dc45b2162490c92fdbb5794f0cbe5b9494 Jun 11 15:16:38.042497 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:38.042480 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c22a57309b21bbb74b841d78061ce0.slice/crio-fc18f299205180893c234361061212792722156f0f441e982884c4035aefe69b WatchSource:0}: Error finding container fc18f299205180893c234361061212792722156f0f441e982884c4035aefe69b: Status 404 returned error can't find the container with id fc18f299205180893c234361061212792722156f0f441e982884c4035aefe69b Jun 11 15:16:38.045800 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.045785 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:16:38.068786 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.068732 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" event={"ID":"1ac02efbad501c753c36f4c24a72e8f4","Type":"ContainerStarted","Data":"0e46310f622a4580ce19651197c050dc45b2162490c92fdbb5794f0cbe5b9494"} Jun 11 15:16:38.069788 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.069766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" event={"ID":"b8c22a57309b21bbb74b841d78061ce0","Type":"ContainerStarted","Data":"fc18f299205180893c234361061212792722156f0f441e982884c4035aefe69b"} Jun 11 15:16:38.083922 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.083903 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.184476 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.184430 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.285016 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.284988 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.385551 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.385479 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.486287 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.486261 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-2.ec2.internal\" not found" Jun 11 15:16:38.501524 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.501503 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:38.534323 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.534306 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:38.590546 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.590526 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" Jun 11 15:16:38.614021 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.613983 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:16:38.615061 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.615041 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" Jun 11 15:16:38.631050 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.631025 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:16:38.969919 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.969885 2582 apiserver.go:52] "Watching apiserver" Jun 11 15:16:38.980356 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.979975 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:16:38.981643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.981613 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-94gwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal","openshift-network-operator/iptables-alerter-kp44l","openshift-ovn-kubernetes/ovnkube-node-nfksd","kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal","openshift-dns/node-resolver-drd78","openshift-image-registry/node-ca-97hsr","openshift-multus/multus-additional-cni-plugins-pfqrc","openshift-multus/multus-qx7n7","openshift-multus/network-metrics-daemon-crdqt","openshift-network-diagnostics/network-check-target-rdtk9","kube-system/global-pull-secret-syncer-bhbvd","kube-system/konnectivity-agent-8xc2w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm"] Jun 11 15:16:38.983494 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.983117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:38.984568 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.984455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:38.984568 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:38.984527 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:38.985841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.985650 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.985841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.985688 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fdxb2\"" Jun 11 15:16:38.985841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.985717 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:16:38.985841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.985650 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.986381 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.986361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:38.988554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.988530 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.988870 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.988843 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.988966 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.988898 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:38.989027 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.988994 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4dbhg\"" Jun 11 15:16:38.989179 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.988904 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:16:38.990170 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.990153 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:38.991498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.990381 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:16:38.991498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.991144 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:16:38.991498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.991157 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:38.992660 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.992127 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:16:38.992801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.992782 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qx7n7" Jun 11 15:16:38.992868 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.992829 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:16:38.992906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.992874 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-btdg7\"" Jun 11 15:16:38.992906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.992896 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.993374 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.993089 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.993374 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.993364 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.993545 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.993478 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.993545 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.993504 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:16:38.994082 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.993827 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:16:38.994082 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.994038 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xxrzw\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.994700 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.995982 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996008 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996102 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996208 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgr2s\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996542 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vfq6v\"" Jun 11 15:16:38.996975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.996591 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:16:38.997278 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.997191 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:16:38.998328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.998307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:38.999085 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.999042 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:16:38.999974 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:38.999926 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:16:39.000135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.000117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.000211 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.000184 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:39.000368 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.000351 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mzppz\"" Jun 11 15:16:39.000624 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.000601 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:16:39.001034 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.001019 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:16:39.001348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.001324 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94gc7\"" Jun 11 15:16:39.001786 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.001493 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.002597 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ef0b0db-fdcd-4212-8da4-3f500808fd39-iptables-alerter-script\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.002681 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002610 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-systemd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002681 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002635 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjjc\" (UniqueName: \"kubernetes.io/projected/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-kube-api-access-dcjjc\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002694 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlt8\" (UniqueName: \"kubernetes.io/projected/69a50c7e-70ba-49e7-bac2-00d48cabd21f-kube-api-access-2hlt8\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-systemd-units\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-slash\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-node-log\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-netd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.002892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002842 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.002896 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115fdfc-4114-47c6-a039-02fdcedff852-hosts-file\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-kubelet\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.002979 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-ovn\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-log-socket\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-env-overrides\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovn-node-metrics-cert\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-registration-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.003119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-sys-fs\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-var-lib-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-etc-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003208 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-bin\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003276 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-socket-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-device-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ef0b0db-fdcd-4212-8da4-3f500808fd39-host-slash\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsvvg\" (UniqueName: \"kubernetes.io/projected/f115fdfc-4114-47c6-a039-02fdcedff852-kube-api-access-hsvvg\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qnh\" (UniqueName: \"kubernetes.io/projected/4ef0b0db-fdcd-4212-8da4-3f500808fd39-kube-api-access-s7qnh\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003410 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115fdfc-4114-47c6-a039-02fdcedff852-tmp-dir\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69a50c7e-70ba-49e7-bac2-00d48cabd21f-serviceca\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-config\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.003534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-script-lib\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.004346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.004346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003565 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-netns\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.004346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52bwl\" (UniqueName: \"kubernetes.io/projected/5d412042-52f9-4727-860a-d7d664df9e1a-kube-api-access-52bwl\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.004346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.003631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a50c7e-70ba-49e7-bac2-00d48cabd21f-host\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.005341 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.005323 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:16:39.005749 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.005579 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cp9t4\"" Jun 11 15:16:39.005849 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.005762 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:16:39.009395 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.009375 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:16:39.045833 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.045808 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c75dm" Jun 11 15:16:39.055664 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.055642 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c75dm" Jun 11 15:16:39.092240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.092191 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:16:39.104644 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-modprobe-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-kubelet-config\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104688 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-socket-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.104819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-device-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-system-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-netns\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-device-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104918 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104849 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsvvg\" (UniqueName: \"kubernetes.io/projected/f115fdfc-4114-47c6-a039-02fdcedff852-kube-api-access-hsvvg\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-hostroot\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.104995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drq6h\" (UniqueName: \"kubernetes.io/projected/ef8ec378-c59e-4edd-a584-f631e3e17452-kube-api-access-drq6h\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115fdfc-4114-47c6-a039-02fdcedff852-tmp-dir\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105040 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-conf\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-host\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-socket-dir-parent\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105121 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-socket-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69a50c7e-70ba-49e7-bac2-00d48cabd21f-serviceca\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52bwl\" (UniqueName: \"kubernetes.io/projected/5d412042-52f9-4727-860a-d7d664df9e1a-kube-api-access-52bwl\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysconfig\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-run\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-tmp\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105412 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sm8\" (UniqueName: \"kubernetes.io/projected/a39d6f51-6c90-49ee-baeb-c550124daa32-kube-api-access-g4sm8\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-systemd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105446 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjjc\" (UniqueName: \"kubernetes.io/projected/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-kube-api-access-dcjjc\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105455 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115fdfc-4114-47c6-a039-02fdcedff852-tmp-dir\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105499 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-systemd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-sys\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-kubelet\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-conf-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-etc-kubernetes\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.105842 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105631 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69a50c7e-70ba-49e7-bac2-00d48cabd21f-serviceca\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlt8\" (UniqueName: \"kubernetes.io/projected/69a50c7e-70ba-49e7-bac2-00d48cabd21f-kube-api-access-2hlt8\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-systemd-units\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-slash\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-systemd-units\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-node-log\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105971 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-multus-certs\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.105999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-slash\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrz2\" (UniqueName: \"kubernetes.io/projected/b359b556-ed0c-45db-b6a9-0e23e66c8456-kube-api-access-wvrz2\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106079 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-node-log\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-ovn\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106148 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-run-ovn\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-log-socket\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106266 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-log-socket\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.106544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-sys-fs\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-multus\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106319 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-sys-fs\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-var-lib-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-etc-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-bin\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-kubernetes\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-dbus\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-daemon-config\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106509 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ef0b0db-fdcd-4212-8da4-3f500808fd39-host-slash\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106565 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-systemd\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-lib-modules\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-bin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47cf754b-71e5-4472-9250-47085b7c076c-konnectivity-ca\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qnh\" (UniqueName: \"kubernetes.io/projected/4ef0b0db-fdcd-4212-8da4-3f500808fd39-kube-api-access-s7qnh\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106733 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.107322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-tuned\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-cnibin\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-config\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-script-lib\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmv2\" (UniqueName: \"kubernetes.io/projected/17998da3-01b2-41cb-94ea-c62ad5fd697b-kube-api-access-gcmv2\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.106978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-cnibin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-netns\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-var-lib-kubelet\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-os-release\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a50c7e-70ba-49e7-bac2-00d48cabd21f-host\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-ovn-kubernetes\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ef0b0db-fdcd-4212-8da4-3f500808fd39-iptables-alerter-script\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-cni-binary-copy\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-k8s-cni-cncf-io\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.108062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47cf754b-71e5-4472-9250-47085b7c076c-agent-certs\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-netd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115fdfc-4114-47c6-a039-02fdcedff852-hosts-file\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-os-release\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-kubelet\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-env-overrides\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovn-node-metrics-cert\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-registration-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107552 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-netd\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107575 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115fdfc-4114-47c6-a039-02fdcedff852-hosts-file\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a50c7e-70ba-49e7-bac2-00d48cabd21f-host\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107828 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-var-lib-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107818 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-env-overrides\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107877 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ef0b0db-fdcd-4212-8da4-3f500808fd39-host-slash\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107903 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-etc-openvswitch\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-run-netns\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.108699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107944 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-script-lib\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.109474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.107957 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-cni-bin\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.109474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.108012 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d412042-52f9-4727-860a-d7d664df9e1a-registration-dir\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.109474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.108010 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-host-kubelet\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.109474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.108348 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovnkube-config\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.109474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.108350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ef0b0db-fdcd-4212-8da4-3f500808fd39-iptables-alerter-script\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.112448 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.111931 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-ovn-node-metrics-cert\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.115678 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.114733 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52bwl\" (UniqueName: \"kubernetes.io/projected/5d412042-52f9-4727-860a-d7d664df9e1a-kube-api-access-52bwl\") pod \"aws-ebs-csi-driver-node-hvmbm\" (UID: \"5d412042-52f9-4727-860a-d7d664df9e1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.115678 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.115406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlt8\" (UniqueName: \"kubernetes.io/projected/69a50c7e-70ba-49e7-bac2-00d48cabd21f-kube-api-access-2hlt8\") pod \"node-ca-97hsr\" (UID: \"69a50c7e-70ba-49e7-bac2-00d48cabd21f\") " pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.116069 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.116045 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:39.116156 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.116071 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:39.116156 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.116085 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:39.116287 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.116183 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:39.616162018 +0000 UTC m=+3.001359393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:39.116287 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.116217 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjjc\" (UniqueName: \"kubernetes.io/projected/e62e24ac-57a7-40a4-a5f3-4d11c0c63d61-kube-api-access-dcjjc\") pod \"ovnkube-node-nfksd\" (UID: \"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61\") " pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.117822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.117779 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsvvg\" (UniqueName: \"kubernetes.io/projected/f115fdfc-4114-47c6-a039-02fdcedff852-kube-api-access-hsvvg\") pod \"node-resolver-drd78\" (UID: \"f115fdfc-4114-47c6-a039-02fdcedff852\") " pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.118906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.118885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qnh\" (UniqueName: \"kubernetes.io/projected/4ef0b0db-fdcd-4212-8da4-3f500808fd39-kube-api-access-s7qnh\") pod \"iptables-alerter-kp44l\" (UID: \"4ef0b0db-fdcd-4212-8da4-3f500808fd39\") " pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.207969 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.207933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-host\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.207975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-socket-dir-parent\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208005 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208034 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysconfig\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-run\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208076 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-host\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-tmp\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sm8\" (UniqueName: \"kubernetes.io/projected/a39d6f51-6c90-49ee-baeb-c550124daa32-kube-api-access-g4sm8\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208142 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysconfig\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-sys\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-kubelet\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208245 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-conf-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-etc-kubernetes\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208313 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-multus-certs\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-run\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrz2\" (UniqueName: \"kubernetes.io/projected/b359b556-ed0c-45db-b6a9-0e23e66c8456-kube-api-access-wvrz2\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-socket-dir-parent\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-multus\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-kubernetes\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-dbus\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-daemon-config\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.208623 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-systemd\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-lib-modules\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-bin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47cf754b-71e5-4472-9250-47085b7c076c-konnectivity-ca\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-tuned\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-cnibin\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208689 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-sys\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmv2\" (UniqueName: \"kubernetes.io/projected/17998da3-01b2-41cb-94ea-c62ad5fd697b-kube-api-access-gcmv2\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208751 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-cnibin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-dbus\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-var-lib-kubelet\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-conf-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-os-release\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-cni-binary-copy\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-k8s-cni-cncf-io\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208890 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-os-release\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.209428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47cf754b-71e5-4472-9250-47085b7c076c-agent-certs\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-os-release\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208937 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-modprobe-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.208990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-kubelet-config\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-system-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-netns\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-hostroot\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drq6h\" (UniqueName: \"kubernetes.io/projected/ef8ec378-c59e-4edd-a584-f631e3e17452-kube-api-access-drq6h\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-conf\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209451 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-daemon-config\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209516 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209521 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-sysctl-conf\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-etc-kubernetes\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209570 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-cnibin\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.210342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209619 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-multus-certs\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209663 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-kubelet\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.209824 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210030 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210082 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-multus\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210138 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-kubernetes\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.210330 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.210390 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:39.710373076 +0000 UTC m=+3.095570452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210589 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-cnibin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210610 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a39d6f51-6c90-49ee-baeb-c550124daa32-cni-binary-copy\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210645 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-var-lib-kubelet\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210671 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-k8s-cni-cncf-io\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.210753 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-lib-modules\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211112 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-var-lib-cni-bin\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211171 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-tmp\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef8ec378-c59e-4edd-a584-f631e3e17452-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-systemd\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211353 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-system-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef8ec378-c59e-4edd-a584-f631e3e17452-os-release\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e1f4a6-54bc-4717-9836-fca554a804d7-kubelet-config\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211458 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-multus-cni-dir\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211521 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-modprobe-d\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.211535 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211550 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-hostroot\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211575 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a39d6f51-6c90-49ee-baeb-c550124daa32-host-run-netns\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.211579 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:39.711564145 +0000 UTC m=+3.096761502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:39.211805 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.211590 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47cf754b-71e5-4472-9250-47085b7c076c-konnectivity-ca\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.212909 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.212864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17998da3-01b2-41cb-94ea-c62ad5fd697b-etc-tuned\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.213414 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.213395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47cf754b-71e5-4472-9250-47085b7c076c-agent-certs\") pod \"konnectivity-agent-8xc2w\" (UID: \"47cf754b-71e5-4472-9250-47085b7c076c\") " pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.218557 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.218536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrz2\" (UniqueName: \"kubernetes.io/projected/b359b556-ed0c-45db-b6a9-0e23e66c8456-kube-api-access-wvrz2\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.226064 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.226006 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmv2\" (UniqueName: \"kubernetes.io/projected/17998da3-01b2-41cb-94ea-c62ad5fd697b-kube-api-access-gcmv2\") pod \"tuned-94gwz\" (UID: \"17998da3-01b2-41cb-94ea-c62ad5fd697b\") " pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.226477 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.226458 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sm8\" (UniqueName: \"kubernetes.io/projected/a39d6f51-6c90-49ee-baeb-c550124daa32-kube-api-access-g4sm8\") pod \"multus-qx7n7\" (UID: \"a39d6f51-6c90-49ee-baeb-c550124daa32\") " pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.228985 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.228963 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drq6h\" (UniqueName: \"kubernetes.io/projected/ef8ec378-c59e-4edd-a584-f631e3e17452-kube-api-access-drq6h\") pod \"multus-additional-cni-plugins-pfqrc\" (UID: \"ef8ec378-c59e-4edd-a584-f631e3e17452\") " pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.296031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.295998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97hsr" Jun 11 15:16:39.307991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.307964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kp44l" Jun 11 15:16:39.318780 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.318758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:16:39.325268 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.325247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" Jun 11 15:16:39.332980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.332959 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-drd78" Jun 11 15:16:39.335411 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.335392 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:39.340608 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.340590 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qx7n7" Jun 11 15:16:39.348618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.348599 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:16:39.356307 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.356284 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" Jun 11 15:16:39.362997 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.362976 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94gwz" Jun 11 15:16:39.713692 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.713612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:39.713692 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.713650 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:39.713703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713795 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713808 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713820 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713841 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713861 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:40.713848116 +0000 UTC m=+4.099045472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713808 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:39.713906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713893 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:40.713876896 +0000 UTC m=+4.099074252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:39.714311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:39.713962 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:40.713945174 +0000 UTC m=+4.099142550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:40.058156 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.058050 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:11:39 +0000 UTC" deadline="2028-03-15 14:27:44.151771982 +0000 UTC" Jun 11 15:16:40.058156 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.058106 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15431h11m4.093670398s" Jun 11 15:16:40.222199 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.222169 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39d6f51_6c90_49ee_baeb_c550124daa32.slice/crio-bb155c6cb9aac797a5e265cea367a752dc5f2e5fde185e39b59c8bff6468f7ab WatchSource:0}: Error finding container bb155c6cb9aac797a5e265cea367a752dc5f2e5fde185e39b59c8bff6468f7ab: Status 404 returned error can't find the container with id bb155c6cb9aac797a5e265cea367a752dc5f2e5fde185e39b59c8bff6468f7ab Jun 11 15:16:40.224478 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.224386 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62e24ac_57a7_40a4_a5f3_4d11c0c63d61.slice/crio-1306dc8b4b98ae25697fcd50362276f14d69436c59cc9530ab50e8a55195f2fc WatchSource:0}: Error finding container 1306dc8b4b98ae25697fcd50362276f14d69436c59cc9530ab50e8a55195f2fc: Status 404 returned error can't find the container with id 1306dc8b4b98ae25697fcd50362276f14d69436c59cc9530ab50e8a55195f2fc Jun 11 15:16:40.228445 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.227810 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef0b0db_fdcd_4212_8da4_3f500808fd39.slice/crio-3d306d45a22233e9274091116ef7d9fdd53d84e1b53889d9ed6f348e9eb4da3b WatchSource:0}: Error finding container 3d306d45a22233e9274091116ef7d9fdd53d84e1b53889d9ed6f348e9eb4da3b: Status 404 returned error can't find the container with id 3d306d45a22233e9274091116ef7d9fdd53d84e1b53889d9ed6f348e9eb4da3b Jun 11 15:16:40.228600 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.228538 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17998da3_01b2_41cb_94ea_c62ad5fd697b.slice/crio-12ee8359d1b3f8257d2d5afe570eea7a9fc4c7ca743bf27681a06edbdb11f852 WatchSource:0}: Error finding container 12ee8359d1b3f8257d2d5afe570eea7a9fc4c7ca743bf27681a06edbdb11f852: Status 404 returned error can't find the container with id 12ee8359d1b3f8257d2d5afe570eea7a9fc4c7ca743bf27681a06edbdb11f852 Jun 11 15:16:40.229859 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.229837 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8ec378_c59e_4edd_a584_f631e3e17452.slice/crio-c836b02161e6c9077dde4ee0fe206d6d53bf686f60f87e5213884632844ecc6b WatchSource:0}: Error finding container c836b02161e6c9077dde4ee0fe206d6d53bf686f60f87e5213884632844ecc6b: Status 404 returned error can't find the container with id c836b02161e6c9077dde4ee0fe206d6d53bf686f60f87e5213884632844ecc6b Jun 11 15:16:40.230440 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:16:40.230416 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d412042_52f9_4727_860a_d7d664df9e1a.slice/crio-0c2e6c27ca1e90ff691072d9dab146e5b0f84499d3c7a5ea1b468c1e408c4570 WatchSource:0}: Error finding container 0c2e6c27ca1e90ff691072d9dab146e5b0f84499d3c7a5ea1b468c1e408c4570: Status 404 returned error can't find the container with id 0c2e6c27ca1e90ff691072d9dab146e5b0f84499d3c7a5ea1b468c1e408c4570 Jun 11 15:16:40.491154 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.491013 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:16:40.721546 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.721458 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:40.721730 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.721581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:40.721730 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:40.721668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:40.721856 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.721830 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.721918 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:42.721897325 +0000 UTC m=+6.107094686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722438 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:42.722475449 +0000 UTC m=+6.107672809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722569 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722587 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722600 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:40.722665 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:40.722633 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:42.722622072 +0000 UTC m=+6.107819428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:41.058839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.058710 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:11:39 +0000 UTC" deadline="2028-02-19 15:18:26.467356796 +0000 UTC" Jun 11 15:16:41.058839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.058770 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14832h1m45.408590725s" Jun 11 15:16:41.068189 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.068163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:41.068361 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:41.068302 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:41.068657 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.068640 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:41.068776 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:41.068728 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:41.068839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.068793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:41.068896 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:41.068876 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:41.102302 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.102258 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-drd78" event={"ID":"f115fdfc-4114-47c6-a039-02fdcedff852","Type":"ContainerStarted","Data":"ce619a0ac447ea6c914249494471585b51e7a76416c5d7ce80fd51ed77ebbbda"} Jun 11 15:16:41.110364 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.110318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97hsr" event={"ID":"69a50c7e-70ba-49e7-bac2-00d48cabd21f","Type":"ContainerStarted","Data":"df04e0d39a918c6e047b5380364dba5a9e703c308b2467d26564ec78e7eea614"} Jun 11 15:16:41.129350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.129315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94gwz" event={"ID":"17998da3-01b2-41cb-94ea-c62ad5fd697b","Type":"ContainerStarted","Data":"12ee8359d1b3f8257d2d5afe570eea7a9fc4c7ca743bf27681a06edbdb11f852"} Jun 11 15:16:41.142685 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.142642 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qx7n7" event={"ID":"a39d6f51-6c90-49ee-baeb-c550124daa32","Type":"ContainerStarted","Data":"bb155c6cb9aac797a5e265cea367a752dc5f2e5fde185e39b59c8bff6468f7ab"} Jun 11 15:16:41.154604 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.153735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" event={"ID":"1ac02efbad501c753c36f4c24a72e8f4","Type":"ContainerStarted","Data":"4af13dd72f309a190153b8571192f212232f4ca670d7309adf51321dcef85eee"} Jun 11 15:16:41.163367 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.163338 2582 generic.go:356] "Generic (PLEG): container finished" podID="b8c22a57309b21bbb74b841d78061ce0" containerID="ac3486ead4b7ba213929325adedbc6b41b4af59f74e5ff65e05e68f48065812e" exitCode=0 Jun 11 15:16:41.163498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.163420 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" event={"ID":"b8c22a57309b21bbb74b841d78061ce0","Type":"ContainerDied","Data":"ac3486ead4b7ba213929325adedbc6b41b4af59f74e5ff65e05e68f48065812e"} Jun 11 15:16:41.169744 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.169694 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-2.ec2.internal" podStartSLOduration=3.169675939 podStartE2EDuration="3.169675939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:16:41.169567113 +0000 UTC m=+4.554764493" watchObservedRunningTime="2026-06-11 15:16:41.169675939 +0000 UTC m=+4.554873299" Jun 11 15:16:41.177558 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.177531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xc2w" event={"ID":"47cf754b-71e5-4472-9250-47085b7c076c","Type":"ContainerStarted","Data":"95c21f1edab93a0897910602b41272789fa1293589a8fd90d84484ad3d22b8bf"} Jun 11 15:16:41.179706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.179677 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" event={"ID":"5d412042-52f9-4727-860a-d7d664df9e1a","Type":"ContainerStarted","Data":"0c2e6c27ca1e90ff691072d9dab146e5b0f84499d3c7a5ea1b468c1e408c4570"} Jun 11 15:16:41.192112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.192045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerStarted","Data":"c836b02161e6c9077dde4ee0fe206d6d53bf686f60f87e5213884632844ecc6b"} Jun 11 15:16:41.197209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.197177 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kp44l" event={"ID":"4ef0b0db-fdcd-4212-8da4-3f500808fd39","Type":"ContainerStarted","Data":"3d306d45a22233e9274091116ef7d9fdd53d84e1b53889d9ed6f348e9eb4da3b"} Jun 11 15:16:41.203906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:41.203869 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"1306dc8b4b98ae25697fcd50362276f14d69436c59cc9530ab50e8a55195f2fc"} Jun 11 15:16:42.225529 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:42.225435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" event={"ID":"b8c22a57309b21bbb74b841d78061ce0","Type":"ContainerStarted","Data":"c43c8bbec5f9f6b53435e395012d70944cedc42ea8cbfe620b3c76ff2b62c776"} Jun 11 15:16:42.740399 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:42.740359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:42.740582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:42.740441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:42.740582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:42.740474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:42.740689 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.740588 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:42.740689 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.740653 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:46.740634133 +0000 UTC m=+10.125831494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:42.741084 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741065 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:42.741150 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741121 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:46.741104856 +0000 UTC m=+10.126302217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:42.741207 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741197 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:42.741291 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741213 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:42.741291 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741245 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:42.741291 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:42.741281 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:46.741267959 +0000 UTC m=+10.126465319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:43.066571 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:43.066533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:43.066743 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:43.066691 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:43.067145 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:43.067124 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:43.067266 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:43.067244 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:43.067402 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:43.067383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:43.067496 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:43.067473 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:45.066274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:45.066240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:45.066274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:45.066260 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:45.066708 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:45.066393 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:45.066708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:45.066404 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:45.066708 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:45.066501 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:45.066708 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:45.066585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:46.775781 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:46.775735 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:46.775793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:46.775837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775882 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775902 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775917 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775932 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:54.775955366 +0000 UTC m=+18.161152722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.775990 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:54.775981048 +0000 UTC m=+18.161178404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.776038 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:46.776311 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:46.776068 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:16:54.776058387 +0000 UTC m=+18.161255742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:47.070085 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:47.070012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:47.070247 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:47.070133 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:47.070307 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:47.070262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:47.070367 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:47.070346 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:47.070415 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:47.070386 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:47.070499 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:47.070483 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:49.068390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:49.068352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:49.068390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:49.068383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:49.069025 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:49.068352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:49.069025 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:49.068488 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:49.069025 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:49.068550 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:49.069025 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:49.068608 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:51.067121 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:51.067027 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:51.067121 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:51.067031 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:51.067569 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:51.067165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:51.067569 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:51.067179 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:51.067569 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:51.067268 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:51.067569 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:51.067356 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:53.066338 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:53.066307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:53.066741 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:53.066349 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:53.066741 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:53.066307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:53.066741 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:53.066451 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:53.066741 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:53.066506 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:53.066741 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:53.066600 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:54.839916 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:54.839874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:54.839916 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:54.839924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840086 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840110 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840117 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840122 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:54.840178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840186 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:10.84016653 +0000 UTC m=+34.225363892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840285 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840285 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:10.840256342 +0000 UTC m=+34.225453712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:16:54.840406 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:54.840321 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:10.84030892 +0000 UTC m=+34.225506293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:16:55.066612 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:55.066569 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:55.066737 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:55.066691 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:55.066737 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:55.066729 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:55.066826 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:55.066781 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:55.066826 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:55.066808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:55.066896 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:55.066870 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:57.067820 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:57.067783 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:57.068461 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:57.067886 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:16:57.068461 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:57.068009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:57.068461 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:57.068101 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:57.068461 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:57.068152 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:57.068461 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:57.068213 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:59.066636 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:59.066604 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:16:59.066636 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:59.066625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:16:59.067262 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:59.066743 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:16:59.067262 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:16:59.066835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:16:59.067262 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:59.066825 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:16:59.067262 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:16:59.066918 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:00.264074 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.263651 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:17:00.264691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264510 2582 generic.go:356] "Generic (PLEG): container finished" podID="e62e24ac-57a7-40a4-a5f3-4d11c0c63d61" containerID="b074edf389ad8450fedc5c0d925d5a02689d908d1ad4aa88f94fe729cd15ee9d" exitCode=1 Jun 11 15:17:00.264691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264583 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"0d499d8ec561ab254a42da1d5975c20434c46fe1d689f5722b9f2945b6de97c7"} Jun 11 15:17:00.264691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264676 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"20027c2872c988b86157003bc17bbdec2cbf3fa196fd21d0031a4b8bb2fb4ed5"} Jun 11 15:17:00.264854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264706 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"407dcf134f7672d23a1be252118a77b8d9ff05e34ab14a67a9aaea8b5342b52e"} Jun 11 15:17:00.264854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"85328be2907d7935c6b2bc5eb56b0acdfb05c0acb50c0394b65f27296fe115a0"} Jun 11 15:17:00.264854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerDied","Data":"b074edf389ad8450fedc5c0d925d5a02689d908d1ad4aa88f94fe729cd15ee9d"} Jun 11 15:17:00.264854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.264826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"b1147426435a63e4fdcdeda42c50dcb3c37d7bb142bb47b235b3b9419f9b3340"} Jun 11 15:17:00.266104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.266070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-drd78" event={"ID":"f115fdfc-4114-47c6-a039-02fdcedff852","Type":"ContainerStarted","Data":"de862a321473d4f7ccc0a81822d5f40302f2590eef352c7cb88f9d583c08a751"} Jun 11 15:17:00.267914 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.267889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97hsr" event={"ID":"69a50c7e-70ba-49e7-bac2-00d48cabd21f","Type":"ContainerStarted","Data":"190635616c6eaed17491bada3939c750eeaa909379b70c8390eca98b9f3b5270"} Jun 11 15:17:00.269582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.269562 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94gwz" event={"ID":"17998da3-01b2-41cb-94ea-c62ad5fd697b","Type":"ContainerStarted","Data":"00789875e5ec90b048cae4337b2eab4f7341fd1ef8ea353fda3bcf53d38cfb65"} Jun 11 15:17:00.271426 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.271400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qx7n7" event={"ID":"a39d6f51-6c90-49ee-baeb-c550124daa32","Type":"ContainerStarted","Data":"3f8f34a4a704c7ac1a3b87b454e4a9319f3e4dafafe1e4e33c21b3e72eeb3681"} Jun 11 15:17:00.273525 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.273501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8xc2w" event={"ID":"47cf754b-71e5-4472-9250-47085b7c076c","Type":"ContainerStarted","Data":"15ad00d120098da9ebfa02695b024aa2f30b02748fd36e1950b91372627c17d6"} Jun 11 15:17:00.275275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.275250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" event={"ID":"5d412042-52f9-4727-860a-d7d664df9e1a","Type":"ContainerStarted","Data":"1983a2b734a3d24849ab0879c3445b33ccb0c4f554d5e6f39b77806e144245c9"} Jun 11 15:17:00.277019 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.276987 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="44b3fc09ae082cd439d12ea76118105b2bfe5f53b478f92fff900967ed3a1ed3" exitCode=0 Jun 11 15:17:00.277131 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.277112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"44b3fc09ae082cd439d12ea76118105b2bfe5f53b478f92fff900967ed3a1ed3"} Jun 11 15:17:00.285161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.284724 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-2.ec2.internal" podStartSLOduration=22.284711978 podStartE2EDuration="22.284711978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:16:42.243870333 +0000 UTC m=+5.629067712" watchObservedRunningTime="2026-06-11 15:17:00.284711978 +0000 UTC m=+23.669909356" Jun 11 15:17:00.285161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.284943 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-drd78" podStartSLOduration=4.2026180029999995 podStartE2EDuration="23.284939247s" totalImagesPullingTime="19.082321244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:00.284397559 +0000 UTC m=+23.669594937" watchObservedRunningTime="2026-06-11 15:17:00.284939247 +0000 UTC m=+23.670136625" Jun 11 15:17:00.306349 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.306292 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qx7n7" podStartSLOduration=3.753991944 podStartE2EDuration="23.306273473s" totalImagesPullingTime="19.552281529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:00.305776554 +0000 UTC m=+23.690973931" watchObservedRunningTime="2026-06-11 15:17:00.306273473 +0000 UTC m=+23.691470851" Jun 11 15:17:00.348702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.348649 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8xc2w" podStartSLOduration=8.553031002 podStartE2EDuration="23.348632176s" totalImagesPullingTime="14.795601174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:00.323773396 +0000 UTC m=+23.708970775" watchObservedRunningTime="2026-06-11 15:17:00.348632176 +0000 UTC m=+23.733829555" Jun 11 15:17:00.372400 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.372341 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-94gwz" podStartSLOduration=4.284790099 podStartE2EDuration="23.372320031s" totalImagesPullingTime="19.087529932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:00.372139553 +0000 UTC m=+23.757336932" watchObservedRunningTime="2026-06-11 15:17:00.372320031 +0000 UTC m=+23.757517409" Jun 11 15:17:00.390659 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.390552 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-97hsr" podStartSLOduration=4.307556961 podStartE2EDuration="23.390532817s" totalImagesPullingTime="19.082975856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:00.389855039 +0000 UTC m=+23.775052483" watchObservedRunningTime="2026-06-11 15:17:00.390532817 +0000 UTC m=+23.775730197" Jun 11 15:17:00.438749 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.438717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:00.514853 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.514811 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:00.581945 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.581911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:00.703171 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:00.703151 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:17:01.067095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.067062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:01.067302 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.067061 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:01.067302 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.067220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:01.067302 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:01.067239 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:01.067470 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:01.067328 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:01.067470 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:01.067412 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:01.069360 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.069282 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:17:00.703166282Z","UUID":"d067d3eb-ab92-41d0-94b1-f674418696f6","Handler":null,"Name":"","Endpoint":""} Jun 11 15:17:01.071348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.071325 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:17:01.071450 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.071365 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:17:01.281676 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.281575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" event={"ID":"5d412042-52f9-4727-860a-d7d664df9e1a","Type":"ContainerStarted","Data":"3eee77c664973150829b34c64a11704b122e9f1e50f2f9feb0150016305c79ea"} Jun 11 15:17:01.283532 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.283358 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kp44l" event={"ID":"4ef0b0db-fdcd-4212-8da4-3f500808fd39","Type":"ContainerStarted","Data":"e915bd8e416f2f7446fefb736a61a4c8fe7e566bf830c8c1121f6a872e2c88c1"} Jun 11 15:17:01.300838 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.300797 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kp44l" podStartSLOduration=5.208229883 podStartE2EDuration="24.300783501s" totalImagesPullingTime="19.092553618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:01.300621677 +0000 UTC m=+24.685819057" watchObservedRunningTime="2026-06-11 15:17:01.300783501 +0000 UTC m=+24.685980879" Jun 11 15:17:01.433433 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.433394 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:01.498076 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:01.498029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:02.039053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:02.038961 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:02.110256 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:02.110205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:02.287443 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:02.287406 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" event={"ID":"5d412042-52f9-4727-860a-d7d664df9e1a","Type":"ContainerStarted","Data":"21125cb6edf4573979b34587a96b4be74a386e85bbf6b638cc38a5fabbb26fe7"} Jun 11 15:17:02.306902 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:02.306810 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hvmbm" podStartSLOduration=4.35160517 podStartE2EDuration="25.306794953s" totalImagesPullingTime="20.955189783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:02.306718844 +0000 UTC m=+25.691916234" watchObservedRunningTime="2026-06-11 15:17:02.306794953 +0000 UTC m=+25.691992331" Jun 11 15:17:03.066512 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:03.066474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:03.066702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:03.066594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:03.066702 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:03.066606 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:03.066702 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:03.066671 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:03.066841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:03.066725 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:03.066841 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:03.066802 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:03.293133 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:03.293104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:17:03.293756 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:03.293534 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"4f5f39fb9ddbdea0e70a1afc7055d2ab8e54b2abb715c53938b09f620f6d5fec"} Jun 11 15:17:04.305436 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:04.305404 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:04.314721 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:04.314695 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:17:04.315312 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:04.315293 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:17:04.370182 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:04.370147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:05.066521 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.066425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:05.066672 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.066434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:05.066672 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.066565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:05.066672 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:05.066557 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:05.066672 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:05.066632 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:05.066810 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:05.066704 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:05.299960 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.299927 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="69b1d1ff65139d07aa9e77175d147c51f2f08e663decf55a50e00c5e0b38d5d4" exitCode=0 Jun 11 15:17:05.300104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.300006 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"69b1d1ff65139d07aa9e77175d147c51f2f08e663decf55a50e00c5e0b38d5d4"} Jun 11 15:17:05.303595 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.303579 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:17:05.304017 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.303984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"0cb5f8aae550da8e606d31a5d391b3c606d995606d79f276c5d94f959b35f27c"} Jun 11 15:17:05.304209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.304190 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:17:05.304408 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.304390 2582 scope.go:117] "RemoveContainer" containerID="b074edf389ad8450fedc5c0d925d5a02689d908d1ad4aa88f94fe729cd15ee9d" Jun 11 15:17:05.304581 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.304566 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8xc2w" Jun 11 15:17:05.439821 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:05.439775 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:06.310636 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.310480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:17:06.314944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.311216 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" event={"ID":"e62e24ac-57a7-40a4-a5f3-4d11c0c63d61","Type":"ContainerStarted","Data":"f2ad353c0bd6272b8cca8dc59518d731ad35cf66063f61942957d0b4b44c82b1"} Jun 11 15:17:06.314944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.313101 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:06.314944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.313217 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:06.314944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.313300 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:06.331304 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.331273 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:06.331597 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.331579 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:06.346860 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.346821 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" podStartSLOduration=10.233809892 podStartE2EDuration="29.346808527s" totalImagesPullingTime="19.112998635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:06.345342337 +0000 UTC m=+29.730539714" watchObservedRunningTime="2026-06-11 15:17:06.346808527 +0000 UTC m=+29.732005905" Jun 11 15:17:06.702157 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.702126 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdtk9"] Jun 11 15:17:06.702680 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.702262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:06.702680 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:06.702342 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:06.705315 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.705293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhbvd"] Jun 11 15:17:06.705434 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.705375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:06.705501 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:06.705452 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:06.705961 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.705937 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-crdqt"] Jun 11 15:17:06.706052 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.706022 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:06.706119 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:06.706102 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:06.802747 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.802670 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:06.903153 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:06.903125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:07.314435 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:07.314406 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="3a60b5f66f9b3a7e1da6745af988922bc644632f69a764e9402ef8b3d023cb56" exitCode=0 Jun 11 15:17:07.314576 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:07.314486 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"3a60b5f66f9b3a7e1da6745af988922bc644632f69a764e9402ef8b3d023cb56"} Jun 11 15:17:08.066984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:08.066952 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:08.067416 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:08.066994 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:08.067416 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:08.067075 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:08.067416 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:08.067203 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:08.318683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:08.318593 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="cd2a3fb82179584403163874bf81e62387b42f66ccd4e4728a552a058f9c5d24" exitCode=0 Jun 11 15:17:08.318815 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:08.318680 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"cd2a3fb82179584403163874bf81e62387b42f66ccd4e4728a552a058f9c5d24"} Jun 11 15:17:09.066971 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:09.066925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:09.067118 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:09.067094 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:10.066554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:10.066523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:10.066827 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:10.066566 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:10.066827 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.066656 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:10.066827 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.066775 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:10.867647 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:10.867418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:10.867669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:10.867708 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867581 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867742 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867759 2582 projected.go:196] Error preparing data for projected volume kube-api-access-97kw4 for pod openshift-network-diagnostics/network-check-target-rdtk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867813 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4 podName:9f72ed03-62af-4925-a43d-9ac3d10853e4 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:42.867800018 +0000 UTC m=+66.252997374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-97kw4" (UniqueName: "kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4") pod "network-check-target-rdtk9" (UID: "9f72ed03-62af-4925-a43d-9ac3d10853e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867823 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867825 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867867 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:42.867851393 +0000 UTC m=+66.253048758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:10.868082 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:10.867884 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret podName:12e1f4a6-54bc-4717-9836-fca554a804d7 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:42.867874955 +0000 UTC m=+66.253072316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret") pod "global-pull-secret-syncer-bhbvd" (UID: "12e1f4a6-54bc-4717-9836-fca554a804d7") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:11.066826 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:11.066746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:11.066988 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:11.066888 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:17:12.066200 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.066161 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:12.066200 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.066195 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:12.066725 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:12.066297 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdtk9" podUID="9f72ed03-62af-4925-a43d-9ac3d10853e4" Jun 11 15:17:12.066725 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:12.066393 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhbvd" podUID="12e1f4a6-54bc-4717-9836-fca554a804d7" Jun 11 15:17:12.472310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.472209 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-2.ec2.internal" event="NodeReady" Jun 11 15:17:12.472447 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.472363 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:17:12.518507 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.518477 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mr68h"] Jun 11 15:17:12.537273 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.537217 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z6zsj"] Jun 11 15:17:12.537401 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.537380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.540617 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.540597 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mfhrn\"" Jun 11 15:17:12.541040 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.541020 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:17:12.541040 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.541034 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:17:12.557085 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.557063 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mr68h"] Jun 11 15:17:12.557166 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.557094 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6zsj"] Jun 11 15:17:12.557166 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.557153 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.559624 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.559605 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-28v89\"" Jun 11 15:17:12.559732 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.559711 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:17:12.559796 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.559754 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:17:12.560006 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.559992 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:17:12.666772 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.666749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:12.678936 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.678912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.679077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.678969 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4acabfe7-e803-488f-addb-6f32b5e027dd-config-volume\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.679077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.678987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acabfe7-e803-488f-addb-6f32b5e027dd-tmp-dir\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.679077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.679048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038adfb6-d968-4415-938f-2e8621f90f64-cert\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.679274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.679126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4sb7\" (UniqueName: \"kubernetes.io/projected/038adfb6-d968-4415-938f-2e8621f90f64-kube-api-access-m4sb7\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.679274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.679164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbjj\" (UniqueName: \"kubernetes.io/projected/4acabfe7-e803-488f-addb-6f32b5e027dd-kube-api-access-7dbjj\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.769048 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.769021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:12.779935 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.779912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.780041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.779967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4acabfe7-e803-488f-addb-6f32b5e027dd-config-volume\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.780041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.779985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acabfe7-e803-488f-addb-6f32b5e027dd-tmp-dir\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.780041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.780002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038adfb6-d968-4415-938f-2e8621f90f64-cert\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.780041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.780029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4sb7\" (UniqueName: \"kubernetes.io/projected/038adfb6-d968-4415-938f-2e8621f90f64-kube-api-access-m4sb7\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.780303 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:12.780055 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:12.780303 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.780066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbjj\" (UniqueName: \"kubernetes.io/projected/4acabfe7-e803-488f-addb-6f32b5e027dd-kube-api-access-7dbjj\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.780303 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:12.780127 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:13.280106117 +0000 UTC m=+36.665303493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:12.780495 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.780364 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acabfe7-e803-488f-addb-6f32b5e027dd-tmp-dir\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.780641 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.780623 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4acabfe7-e803-488f-addb-6f32b5e027dd-config-volume\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.784271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.784253 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038adfb6-d968-4415-938f-2e8621f90f64-cert\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.793044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.793025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4sb7\" (UniqueName: \"kubernetes.io/projected/038adfb6-d968-4415-938f-2e8621f90f64-kube-api-access-m4sb7\") pod \"ingress-canary-z6zsj\" (UID: \"038adfb6-d968-4415-938f-2e8621f90f64\") " pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:12.793172 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.793055 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbjj\" (UniqueName: \"kubernetes.io/projected/4acabfe7-e803-488f-addb-6f32b5e027dd-kube-api-access-7dbjj\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:12.865121 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:12.865094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6zsj" Jun 11 15:17:13.033417 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.033349 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6zsj"] Jun 11 15:17:13.037437 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:17:13.037414 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038adfb6_d968_4415_938f_2e8621f90f64.slice/crio-7a07455aa92b2a258cf9a04fe19e6968c671afbf213b2812d8dbc05689bbd3b8 WatchSource:0}: Error finding container 7a07455aa92b2a258cf9a04fe19e6968c671afbf213b2812d8dbc05689bbd3b8: Status 404 returned error can't find the container with id 7a07455aa92b2a258cf9a04fe19e6968c671afbf213b2812d8dbc05689bbd3b8 Jun 11 15:17:13.066831 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.066806 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:13.069544 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.069526 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:17:13.069636 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.069622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptqhc\"" Jun 11 15:17:13.282471 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.282438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:13.282605 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:13.282562 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:13.282639 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:13.282613 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:14.282599868 +0000 UTC m=+37.667797224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:13.334447 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.334373 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="237f857e0b3824e64abcc63b09f8ddc38184b6ff159a111cd908725e78e9dcc9" exitCode=0 Jun 11 15:17:13.334591 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.334459 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"237f857e0b3824e64abcc63b09f8ddc38184b6ff159a111cd908725e78e9dcc9"} Jun 11 15:17:13.335582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:13.335560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6zsj" event={"ID":"038adfb6-d968-4415-938f-2e8621f90f64","Type":"ContainerStarted","Data":"7a07455aa92b2a258cf9a04fe19e6968c671afbf213b2812d8dbc05689bbd3b8"} Jun 11 15:17:14.067017 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.066846 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:14.067478 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.066848 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:14.069944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.069926 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:17:14.070068 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.069926 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:17:14.070991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.070976 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-846lr\"" Jun 11 15:17:14.071043 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.070993 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:17:14.289081 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.289048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:14.289260 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:14.289206 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:14.289303 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:14.289287 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:16.289270806 +0000 UTC m=+39.674468162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:14.342045 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.341956 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef8ec378-c59e-4edd-a584-f631e3e17452" containerID="5cef14c0eb2f9d3e63ab1e380a9651278eb9b45f4e14e3ac9b00dc114afd2861" exitCode=0 Jun 11 15:17:14.342045 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:14.342025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerDied","Data":"5cef14c0eb2f9d3e63ab1e380a9651278eb9b45f4e14e3ac9b00dc114afd2861"} Jun 11 15:17:15.348353 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:15.348310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" event={"ID":"ef8ec378-c59e-4edd-a584-f631e3e17452","Type":"ContainerStarted","Data":"977bc30f9efa3df33de147370b3747dc633e29617a4dc3b9df242581a31f7280"} Jun 11 15:17:15.376868 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:15.376816 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pfqrc" podStartSLOduration=9.21176217 podStartE2EDuration="38.376799977s" totalImagesPullingTime="29.165037807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:15.375139871 +0000 UTC m=+38.760337249" watchObservedRunningTime="2026-06-11 15:17:15.376799977 +0000 UTC m=+38.761997354" Jun 11 15:17:15.498942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:15.498915 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:15.601038 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:15.600924 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:16.301570 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:16.301523 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:16.301748 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:16.301680 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:16.301796 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:16.301748 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:20.301732293 +0000 UTC m=+43.686929648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:16.352206 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:16.352174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6zsj" event={"ID":"038adfb6-d968-4415-938f-2e8621f90f64","Type":"ContainerStarted","Data":"e247883bc11ce1badf1210c86ac7f05ceee5adafd1c43e321ce8bac4f08db8a7"} Jun 11 15:17:16.370181 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:16.370082 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z6zsj" podStartSLOduration=1.987756087 podStartE2EDuration="4.370068754s" totalImagesPullingTime="2.382312667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:16.368744195 +0000 UTC m=+39.753941610" watchObservedRunningTime="2026-06-11 15:17:16.370068754 +0000 UTC m=+39.755266132" Jun 11 15:17:17.236420 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:17.236384 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:17.302689 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:17.302656 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:17.851438 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:17.851400 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:17.947627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:17.947600 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:20.324909 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:20.324876 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:20.325304 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:20.325005 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:20.325304 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:20.325058 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:28.325045404 +0000 UTC m=+51.710242761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:28.291533 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:28.291499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:28.381364 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:28.381332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:28.381540 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:28.381438 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:28.381540 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:28.381491 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:17:44.38147616 +0000 UTC m=+67.766673538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:28.393993 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:28.393956 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:38.330312 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:38.330283 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nfksd" Jun 11 15:17:38.483448 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:38.483414 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:38.554495 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:38.554466 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:17:42.880801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.880760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:17:42.881353 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.880825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:42.881353 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.880945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:42.885136 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.885116 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:17:42.885136 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.885133 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:17:42.885249 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.885187 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:17:42.891504 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:42.891487 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:17:42.891562 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:42.891553 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:46.891531015 +0000 UTC m=+130.276728372 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : secret "metrics-daemon-secret" not found Jun 11 15:17:42.895037 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.895002 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e1f4a6-54bc-4717-9836-fca554a804d7-original-pull-secret\") pod \"global-pull-secret-syncer-bhbvd\" (UID: \"12e1f4a6-54bc-4717-9836-fca554a804d7\") " pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:42.895710 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.895693 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:17:42.904343 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:42.904319 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97kw4\" (UniqueName: \"kubernetes.io/projected/9f72ed03-62af-4925-a43d-9ac3d10853e4-kube-api-access-97kw4\") pod \"network-check-target-rdtk9\" (UID: \"9f72ed03-62af-4925-a43d-9ac3d10853e4\") " pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:43.177070 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.176979 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhbvd" Jun 11 15:17:43.185504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.185482 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-846lr\"" Jun 11 15:17:43.193174 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.193154 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:43.335863 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.335001 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhbvd"] Jun 11 15:17:43.348937 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.348913 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdtk9"] Jun 11 15:17:43.351269 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:17:43.351220 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f72ed03_62af_4925_a43d_9ac3d10853e4.slice/crio-e53d3aae41c8603a0a612a68ba4a346c68a3e8ffb98367333e3a022d72908f62 WatchSource:0}: Error finding container e53d3aae41c8603a0a612a68ba4a346c68a3e8ffb98367333e3a022d72908f62: Status 404 returned error can't find the container with id e53d3aae41c8603a0a612a68ba4a346c68a3e8ffb98367333e3a022d72908f62 Jun 11 15:17:43.415153 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.415114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdtk9" event={"ID":"9f72ed03-62af-4925-a43d-9ac3d10853e4","Type":"ContainerStarted","Data":"e53d3aae41c8603a0a612a68ba4a346c68a3e8ffb98367333e3a022d72908f62"} Jun 11 15:17:43.416202 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:43.416176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhbvd" event={"ID":"12e1f4a6-54bc-4717-9836-fca554a804d7","Type":"ContainerStarted","Data":"1440e9b4c94a7081f2c992f1f15c89a51d0a9330509e960519e765a4392c14c9"} Jun 11 15:17:44.393980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:44.393937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:17:44.394446 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:44.394100 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:17:44.394446 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:17:44.394167 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:18:16.39414945 +0000 UTC m=+99.779346809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:17:48.431548 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:48.431510 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdtk9" event={"ID":"9f72ed03-62af-4925-a43d-9ac3d10853e4","Type":"ContainerStarted","Data":"d2c7cb2f0f7fd7a4448db598f9af999cc7221623baf01f9ac2ebb8780a23af50"} Jun 11 15:17:48.432117 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:48.431610 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:17:48.432955 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:48.432928 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhbvd" event={"ID":"12e1f4a6-54bc-4717-9836-fca554a804d7","Type":"ContainerStarted","Data":"6bd8e540f4199caf2399481a1f7760607f3ef1425acc4e608b53db16467da275"} Jun 11 15:17:48.449355 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:48.449303 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rdtk9" podStartSLOduration=67.042102718 podStartE2EDuration="1m11.449289398s" totalImagesPullingTime="4.40718668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:48.448806901 +0000 UTC m=+71.834004293" watchObservedRunningTime="2026-06-11 15:17:48.449289398 +0000 UTC m=+71.834486770" Jun 11 15:17:48.465125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:17:48.465077 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bhbvd" podStartSLOduration=67.039343221 podStartE2EDuration="1m11.465066529s" totalImagesPullingTime="4.425723308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:48.464711307 +0000 UTC m=+71.849908685" watchObservedRunningTime="2026-06-11 15:17:48.465066529 +0000 UTC m=+71.850263906" Jun 11 15:18:16.413575 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:18:16.413475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:18:16.413991 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:18:16.413641 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:16.413991 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:18:16.413726 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:19:20.413707483 +0000 UTC m=+163.798904860 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:18:19.437325 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:18:19.437288 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rdtk9" Jun 11 15:18:46.924617 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:18:46.924581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:18:46.925129 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:18:46.924674 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:18:46.925129 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:18:46.924753 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:20:48.924735568 +0000 UTC m=+252.309932943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : secret "metrics-daemon-secret" not found Jun 11 15:19:15.547937 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:19:15.547888 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mr68h" podUID="4acabfe7-e803-488f-addb-6f32b5e027dd" Jun 11 15:19:15.640443 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:19:15.640409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr68h" Jun 11 15:19:16.078823 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:19:16.078774 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:19:20.456042 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:19:20.455997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:19:20.456474 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:19:20.456110 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:19:20.456474 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:19:20.456163 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls podName:4acabfe7-e803-488f-addb-6f32b5e027dd nodeName:}" failed. No retries permitted until 2026-06-11 15:21:22.456149832 +0000 UTC m=+285.841347188 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls") pod "dns-default-mr68h" (UID: "4acabfe7-e803-488f-addb-6f32b5e027dd") : secret "dns-default-metrics-tls" not found Jun 11 15:19:31.066513 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:19:31.066423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:20:07.617699 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:07.617666 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:17.787307 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:17.787274 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:30.531726 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:30.531689 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:30.606394 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:30.606362 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:45.009541 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.009501 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr"] Jun 11 15:20:45.011361 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.011345 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" Jun 11 15:20:45.021676 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.021655 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 15:20:45.022433 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.022416 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zz84x\"" Jun 11 15:20:45.025197 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.025185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:20:45.049747 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.049704 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr"] Jun 11 15:20:45.112618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.112582 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4"] Jun 11 15:20:45.114366 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.114349 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.115966 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.115942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjt5\" (UniqueName: \"kubernetes.io/projected/47bd9080-5edf-47fd-a023-fe2e823dc030-kube-api-access-5pjt5\") pod \"volume-data-source-validator-78dd696465-wz6pr\" (UID: \"47bd9080-5edf-47fd-a023-fe2e823dc030\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" Jun 11 15:20:45.117922 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.117897 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 15:20:45.117922 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.117915 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 15:20:45.118143 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.118031 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-wvbs5"] Jun 11 15:20:45.119119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.119101 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 15:20:45.119444 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.119427 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fkd6x\"" Jun 11 15:20:45.119709 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.119690 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv"] Jun 11 15:20:45.119838 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.119822 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.119998 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.119970 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:20:45.121423 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.121403 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2"] Jun 11 15:20:45.121527 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.121495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.123125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.123105 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.127545 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.127525 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:20:45.128003 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.127983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 15:20:45.128071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.127983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:20:45.128322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.128294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 15:20:45.128322 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.128294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 15:20:45.128479 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.128458 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:20:45.129291 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.129271 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4"] Jun 11 15:20:45.129759 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.129728 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 15:20:45.130195 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.130171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:20:45.130335 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.130174 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 15:20:45.130335 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.130200 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 15:20:45.130335 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.130201 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8hpgw\"" Jun 11 15:20:45.130335 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.130204 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:20:45.131129 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.131113 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rcn7c\"" Jun 11 15:20:45.131414 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.131392 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 15:20:45.131609 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.131588 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qgsms\"" Jun 11 15:20:45.134694 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.134675 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 15:20:45.134830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.134810 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wvbs5"] Jun 11 15:20:45.138438 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.138418 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv"] Jun 11 15:20:45.139309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.139290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2"] Jun 11 15:20:45.216493 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bsqp\" (UniqueName: \"kubernetes.io/projected/424b4b65-0e4c-4112-9535-9482a6641cc3-kube-api-access-5bsqp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216493 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71427ad7-8f03-4ce1-8272-2014c07a79b1-config\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-snapshots\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6165b866-1b23-4d51-a2c3-0313574aa02f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-tmp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216641 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zb2p\" (UniqueName: \"kubernetes.io/projected/71427ad7-8f03-4ce1-8272-2014c07a79b1-kube-api-access-2zb2p\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/424b4b65-0e4c-4112-9535-9482a6641cc3-serving-cert\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216695 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjt5\" (UniqueName: \"kubernetes.io/projected/47bd9080-5edf-47fd-a023-fe2e823dc030-kube-api-access-5pjt5\") pod \"volume-data-source-validator-78dd696465-wz6pr\" (UID: \"47bd9080-5edf-47fd-a023-fe2e823dc030\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g62r\" (UniqueName: \"kubernetes.io/projected/6165b866-1b23-4d51-a2c3-0313574aa02f-kube-api-access-2g62r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s67b\" (UniqueName: \"kubernetes.io/projected/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-kube-api-access-5s67b\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427ad7-8f03-4ce1-8272-2014c07a79b1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-service-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216875 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-trusted-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.216912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.216890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6165b866-1b23-4d51-a2c3-0313574aa02f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.225390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.225361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjt5\" (UniqueName: \"kubernetes.io/projected/47bd9080-5edf-47fd-a023-fe2e823dc030-kube-api-access-5pjt5\") pod \"volume-data-source-validator-78dd696465-wz6pr\" (UID: \"47bd9080-5edf-47fd-a023-fe2e823dc030\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" Jun 11 15:20:45.279121 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.279035 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:45.318240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427ad7-8f03-4ce1-8272-2014c07a79b1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.318333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-service-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-trusted-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6165b866-1b23-4d51-a2c3-0313574aa02f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318334 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsqp\" (UniqueName: \"kubernetes.io/projected/424b4b65-0e4c-4112-9535-9482a6641cc3-kube-api-access-5bsqp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71427ad7-8f03-4ce1-8272-2014c07a79b1-config\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-snapshots\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6165b866-1b23-4d51-a2c3-0313574aa02f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.318468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-tmp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318743 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:45.318486 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:45.318743 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:45.318556 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:20:45.818536974 +0000 UTC m=+249.203734330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:45.318743 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zb2p\" (UniqueName: \"kubernetes.io/projected/71427ad7-8f03-4ce1-8272-2014c07a79b1-kube-api-access-2zb2p\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.318743 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/424b4b65-0e4c-4112-9535-9482a6641cc3-serving-cert\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.318743 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.319005 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g62r\" (UniqueName: \"kubernetes.io/projected/6165b866-1b23-4d51-a2c3-0313574aa02f-kube-api-access-2g62r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.319005 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.318810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s67b\" (UniqueName: \"kubernetes.io/projected/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-kube-api-access-5s67b\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.319110 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319019 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-service-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.319775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319382 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71427ad7-8f03-4ce1-8272-2014c07a79b1-config\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.319775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" Jun 11 15:20:45.319775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319586 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-tmp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.319775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6165b866-1b23-4d51-a2c3-0313574aa02f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.320040 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319822 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424b4b65-0e4c-4112-9535-9482a6641cc3-trusted-ca-bundle\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.320040 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319909 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/424b4b65-0e4c-4112-9535-9482a6641cc3-snapshots\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.320040 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.319969 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.321029 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.321006 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6165b866-1b23-4d51-a2c3-0313574aa02f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.321331 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.321313 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/424b4b65-0e4c-4112-9535-9482a6641cc3-serving-cert\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.321406 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.321337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427ad7-8f03-4ce1-8272-2014c07a79b1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.327909 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.327880 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g62r\" (UniqueName: \"kubernetes.io/projected/6165b866-1b23-4d51-a2c3-0313574aa02f-kube-api-access-2g62r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-55kw2\" (UID: \"6165b866-1b23-4d51-a2c3-0313574aa02f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.328377 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.328342 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bsqp\" (UniqueName: \"kubernetes.io/projected/424b4b65-0e4c-4112-9535-9482a6641cc3-kube-api-access-5bsqp\") pod \"insights-operator-896549976-wvbs5\" (UID: \"424b4b65-0e4c-4112-9535-9482a6641cc3\") " pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.328660 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.328621 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zb2p\" (UniqueName: \"kubernetes.io/projected/71427ad7-8f03-4ce1-8272-2014c07a79b1-kube-api-access-2zb2p\") pod \"service-ca-operator-6bc5ff68f5-6p5n4\" (UID: \"71427ad7-8f03-4ce1-8272-2014c07a79b1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.328987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.328968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s67b\" (UniqueName: \"kubernetes.io/projected/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-kube-api-access-5s67b\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.380462 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.380357 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:45.425633 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.425602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" Jun 11 15:20:45.431721 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.431695 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wvbs5" Jun 11 15:20:45.447654 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.446562 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr"] Jun 11 15:20:45.447654 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.446745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" Jun 11 15:20:45.576301 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.576264 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4"] Jun 11 15:20:45.579154 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:20:45.579118 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71427ad7_8f03_4ce1_8272_2014c07a79b1.slice/crio-efab229db0558002427530ef3bac57932a759052e0af124bd4847940c6c134fb WatchSource:0}: Error finding container efab229db0558002427530ef3bac57932a759052e0af124bd4847940c6c134fb: Status 404 returned error can't find the container with id efab229db0558002427530ef3bac57932a759052e0af124bd4847940c6c134fb Jun 11 15:20:45.797044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.796954 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2"] Jun 11 15:20:45.800420 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.800391 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wvbs5"] Jun 11 15:20:45.800685 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:20:45.800614 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6165b866_1b23_4d51_a2c3_0313574aa02f.slice/crio-b6876f6040695a945477064aaabe14db79fef4f83f15b9ec972aad05899d135d WatchSource:0}: Error finding container b6876f6040695a945477064aaabe14db79fef4f83f15b9ec972aad05899d135d: Status 404 returned error can't find the container with id b6876f6040695a945477064aaabe14db79fef4f83f15b9ec972aad05899d135d Jun 11 15:20:45.802900 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:20:45.802879 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424b4b65_0e4c_4112_9535_9482a6641cc3.slice/crio-d8a7bd410fe85eefbb5ac85b0c470b98ef8f68a2ca7a03e89c40dffb30da3332 WatchSource:0}: Error finding container d8a7bd410fe85eefbb5ac85b0c470b98ef8f68a2ca7a03e89c40dffb30da3332: Status 404 returned error can't find the container with id d8a7bd410fe85eefbb5ac85b0c470b98ef8f68a2ca7a03e89c40dffb30da3332 Jun 11 15:20:45.822499 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.822476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:45.822611 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:45.822603 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:45.822698 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:45.822648 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:20:46.82263563 +0000 UTC m=+250.207832987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:45.867187 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.867147 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wvbs5" event={"ID":"424b4b65-0e4c-4112-9535-9482a6641cc3","Type":"ContainerStarted","Data":"d8a7bd410fe85eefbb5ac85b0c470b98ef8f68a2ca7a03e89c40dffb30da3332"} Jun 11 15:20:45.868603 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.868578 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" event={"ID":"71427ad7-8f03-4ce1-8272-2014c07a79b1","Type":"ContainerStarted","Data":"efab229db0558002427530ef3bac57932a759052e0af124bd4847940c6c134fb"} Jun 11 15:20:45.869861 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.869834 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" event={"ID":"6165b866-1b23-4d51-a2c3-0313574aa02f","Type":"ContainerStarted","Data":"b6876f6040695a945477064aaabe14db79fef4f83f15b9ec972aad05899d135d"} Jun 11 15:20:45.871064 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:45.871033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" event={"ID":"47bd9080-5edf-47fd-a023-fe2e823dc030","Type":"ContainerStarted","Data":"ebcead8f14019a09e56b1a7b5cc68d65480feea2f6628b0792772d9e2aaa3ab9"} Jun 11 15:20:46.832717 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:46.832068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:46.832717 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:46.832268 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:46.832717 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:46.832339 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:20:48.832319101 +0000 UTC m=+252.217516481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:46.876248 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:46.876197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" event={"ID":"47bd9080-5edf-47fd-a023-fe2e823dc030","Type":"ContainerStarted","Data":"8da7c4f6efd017c2129cc59561233887ae577cbb5f9d874a3205563af26c4df2"} Jun 11 15:20:46.895039 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:46.894929 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wz6pr" podStartSLOduration=1.638625006 podStartE2EDuration="2.894911801s" totalImagesPullingTime="1.256286795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:46.894587807 +0000 UTC m=+250.279785187" watchObservedRunningTime="2026-06-11 15:20:46.894911801 +0000 UTC m=+250.280109181" Jun 11 15:20:46.979266 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:46.979158 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:47.043677 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:47.043615 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:48.849965 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.849902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:48.850413 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:48.850087 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:48.850413 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:48.850172 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:20:52.850151982 +0000 UTC m=+256.235349351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:48.884825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.884512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" event={"ID":"71427ad7-8f03-4ce1-8272-2014c07a79b1","Type":"ContainerStarted","Data":"65766d5aedf94d5aa4901b9a0066f151e0c7c55b7c4c8dfd6cecd866d0028d1f"} Jun 11 15:20:48.886564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.886528 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" event={"ID":"6165b866-1b23-4d51-a2c3-0313574aa02f","Type":"ContainerStarted","Data":"2b069ec8f56b7dd6ebc0a5c02da807ee4751ccce93274a989fe6dd6cd1b35e0b"} Jun 11 15:20:48.888117 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.888084 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wvbs5" event={"ID":"424b4b65-0e4c-4112-9535-9482a6641cc3","Type":"ContainerStarted","Data":"f4888be171bf8261dd6dc19438f55903042c7b649932492ad2a35e3aa532cf22"} Jun 11 15:20:48.903792 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.903740 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" podStartSLOduration=0.826797567 podStartE2EDuration="3.903720074s" totalImagesPullingTime="3.076922507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:48.902292551 +0000 UTC m=+252.287489952" watchObservedRunningTime="2026-06-11 15:20:48.903720074 +0000 UTC m=+252.288917453" Jun 11 15:20:48.920550 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.920492 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-wvbs5" podStartSLOduration=1.070143752 podStartE2EDuration="3.920476708s" totalImagesPullingTime="2.850332956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:48.919802939 +0000 UTC m=+252.305000318" watchObservedRunningTime="2026-06-11 15:20:48.920476708 +0000 UTC m=+252.305674087" Jun 11 15:20:48.942339 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.942274 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" podStartSLOduration=1.092527483 podStartE2EDuration="3.942255029s" totalImagesPullingTime="2.849727546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:48.941514292 +0000 UTC m=+252.326711672" watchObservedRunningTime="2026-06-11 15:20:48.942255029 +0000 UTC m=+252.327452406" Jun 11 15:20:48.950647 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:48.950606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:20:48.951336 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:48.951316 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:20:48.951404 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:48.951380 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs podName:b359b556-ed0c-45db-b6a9-0e23e66c8456 nodeName:}" failed. No retries permitted until 2026-06-11 15:22:50.951360874 +0000 UTC m=+374.336558242 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs") pod "network-metrics-daemon-crdqt" (UID: "b359b556-ed0c-45db-b6a9-0e23e66c8456") : secret "metrics-daemon-secret" not found Jun 11 15:20:49.652689 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:49.652643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:49.728143 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:49.728102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:50.462421 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.462389 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x"] Jun 11 15:20:50.466638 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.466595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" Jun 11 15:20:50.469493 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.469466 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 15:20:50.469628 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.469514 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 15:20:50.470460 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.470442 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v8gfp\"" Jun 11 15:20:50.475432 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.475364 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x"] Jun 11 15:20:50.475584 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.475558 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:50.539735 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.539695 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:50.565799 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.565770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dlc\" (UniqueName: \"kubernetes.io/projected/8edc0b65-e12d-4577-b872-35cf338684d2-kube-api-access-k2dlc\") pod \"migrator-955ffdf5f-j722x\" (UID: \"8edc0b65-e12d-4577-b872-35cf338684d2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" Jun 11 15:20:50.639178 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.639147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:50.666156 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.666117 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dlc\" (UniqueName: \"kubernetes.io/projected/8edc0b65-e12d-4577-b872-35cf338684d2-kube-api-access-k2dlc\") pod \"migrator-955ffdf5f-j722x\" (UID: \"8edc0b65-e12d-4577-b872-35cf338684d2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" Jun 11 15:20:50.675079 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.675043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dlc\" (UniqueName: \"kubernetes.io/projected/8edc0b65-e12d-4577-b872-35cf338684d2-kube-api-access-k2dlc\") pod \"migrator-955ffdf5f-j722x\" (UID: \"8edc0b65-e12d-4577-b872-35cf338684d2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" Jun 11 15:20:50.776853 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.776823 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" Jun 11 15:20:50.904934 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.904904 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x"] Jun 11 15:20:50.907732 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:20:50.907707 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edc0b65_e12d_4577_b872_35cf338684d2.slice/crio-49d74305fc9af326601e59c1d017868042e064df94aebede69a911be1bebec15 WatchSource:0}: Error finding container 49d74305fc9af326601e59c1d017868042e064df94aebede69a911be1bebec15: Status 404 returned error can't find the container with id 49d74305fc9af326601e59c1d017868042e064df94aebede69a911be1bebec15 Jun 11 15:20:50.921156 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:50.921129 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:51.188256 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:51.188148 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:51.280240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:51.280192 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:51.601650 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:51.601619 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-drd78_f115fdfc-4114-47c6-a039-02fdcedff852/dns-node-resolver/0.log" Jun 11 15:20:51.899148 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:51.899078 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" event={"ID":"8edc0b65-e12d-4577-b872-35cf338684d2","Type":"ContainerStarted","Data":"49d74305fc9af326601e59c1d017868042e064df94aebede69a911be1bebec15"} Jun 11 15:20:52.602026 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.601998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97hsr_69a50c7e-70ba-49e7-bac2-00d48cabd21f/node-ca/0.log" Jun 11 15:20:52.781269 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.781217 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5w646"] Jun 11 15:20:52.784104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.784088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.786578 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.786554 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 15:20:52.786820 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.786807 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 15:20:52.787649 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.787636 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mmsk5\"" Jun 11 15:20:52.787713 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.787672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 15:20:52.787713 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.787696 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 15:20:52.792487 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.792464 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5w646"] Jun 11 15:20:52.817346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.817303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:52.882353 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.882249 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:52.885169 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.885148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/05b0390f-fa55-46eb-a83d-464128a93066-signing-key\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.885255 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.885182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:20:52.885255 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.885202 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4p2n\" (UniqueName: \"kubernetes.io/projected/05b0390f-fa55-46eb-a83d-464128a93066-kube-api-access-q4p2n\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.885335 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:52.885297 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:52.885374 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.885327 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/05b0390f-fa55-46eb-a83d-464128a93066-signing-cabundle\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.885374 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:20:52.885343 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:21:00.885330758 +0000 UTC m=+264.270528118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:20:52.904371 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.904341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" event={"ID":"8edc0b65-e12d-4577-b872-35cf338684d2","Type":"ContainerStarted","Data":"8a7dc716ce17e32dbfa75e45535486dc45c9976bd8816e30bdc8027ca213d272"} Jun 11 15:20:52.904550 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.904402 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" event={"ID":"8edc0b65-e12d-4577-b872-35cf338684d2","Type":"ContainerStarted","Data":"d3c530a3962f6cc8f38c5f988fb88090d0734f65f9428087d955d653fd4c42e6"} Jun 11 15:20:52.922243 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.922165 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-j722x" podStartSLOduration=1.884541526 podStartE2EDuration="2.922145107s" totalImagesPullingTime="1.037603581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:52.920543165 +0000 UTC m=+256.305740543" watchObservedRunningTime="2026-06-11 15:20:52.922145107 +0000 UTC m=+256.307342487" Jun 11 15:20:52.986552 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.986511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/05b0390f-fa55-46eb-a83d-464128a93066-signing-cabundle\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.986750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.986601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/05b0390f-fa55-46eb-a83d-464128a93066-signing-key\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.986750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.986640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4p2n\" (UniqueName: \"kubernetes.io/projected/05b0390f-fa55-46eb-a83d-464128a93066-kube-api-access-q4p2n\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.987214 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.987189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/05b0390f-fa55-46eb-a83d-464128a93066-signing-cabundle\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.989390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.989365 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/05b0390f-fa55-46eb-a83d-464128a93066-signing-key\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:52.995359 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:52.995333 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4p2n\" (UniqueName: \"kubernetes.io/projected/05b0390f-fa55-46eb-a83d-464128a93066-kube-api-access-q4p2n\") pod \"service-ca-7d74d578b8-5w646\" (UID: \"05b0390f-fa55-46eb-a83d-464128a93066\") " pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:53.002900 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.002860 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:53.093408 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.093375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5w646" Jun 11 15:20:53.105140 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.105092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:53.220841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.220804 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5w646"] Jun 11 15:20:53.223893 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:20:53.223862 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b0390f_fa55_46eb_a83d_464128a93066.slice/crio-5a7d37f0fa8d10ffde2046b1747b432c18a972338b51d1d407779dc0b02ff970 WatchSource:0}: Error finding container 5a7d37f0fa8d10ffde2046b1747b432c18a972338b51d1d407779dc0b02ff970: Status 404 returned error can't find the container with id 5a7d37f0fa8d10ffde2046b1747b432c18a972338b51d1d407779dc0b02ff970 Jun 11 15:20:53.601880 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.601846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z6zsj_038adfb6-d968-4415-938f-2e8621f90f64/serve-healthcheck-canary/0.log" Jun 11 15:20:53.681288 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.681219 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:53.909186 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.909080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5w646" event={"ID":"05b0390f-fa55-46eb-a83d-464128a93066","Type":"ContainerStarted","Data":"b96fd934ad6b7ed6a43ed38737821b3bc296a87a2e8cbccac79870d58a9f5b4d"} Jun 11 15:20:53.909186 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.909142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5w646" event={"ID":"05b0390f-fa55-46eb-a83d-464128a93066","Type":"ContainerStarted","Data":"5a7d37f0fa8d10ffde2046b1747b432c18a972338b51d1d407779dc0b02ff970"} Jun 11 15:20:53.931022 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:53.930968 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-5w646" podStartSLOduration=1.930951085 podStartE2EDuration="1.930951085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:53.929292033 +0000 UTC m=+257.314489410" watchObservedRunningTime="2026-06-11 15:20:53.930951085 +0000 UTC m=+257.316148506" Jun 11 15:20:54.426559 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:54.426463 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:54.631846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:54.631804 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:54.734510 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:54.734407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:54.837184 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:54.837152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:55.124672 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:55.124623 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:56.315701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:56.315667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:56.513648 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:56.513613 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:56.727185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:56.727096 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:56.921550 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:56.921516 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:57.117152 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:57.117114 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.113287 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.113253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.320733 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.320702 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.419881 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.419753 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.730858 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.730769 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.827342 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.827302 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:58.926436 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:58.926394 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:59.517395 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:59.517356 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:20:59.913839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:20:59.913726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:00.123912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:00.123874 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:00.951866 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:00.951826 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:21:00.952263 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:00.951957 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 15:21:00.952263 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:00.952011 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls podName:7fea8725-773d-4fd0-a2ab-93a9b28b02cc nodeName:}" failed. No retries permitted until 2026-06-11 15:21:16.951997849 +0000 UTC m=+280.337195207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hrjzv" (UID: "7fea8725-773d-4fd0-a2ab-93a9b28b02cc") : secret "cluster-monitoring-operator-tls" not found Jun 11 15:21:01.174405 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:01.174368 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:01.731665 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:01.731630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:01.918489 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:01.918451 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:02.126044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:02.125994 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:02.334165 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:02.334134 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:02.698020 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:02.697969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:03.323136 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:03.323100 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:03.528566 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:03.528532 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:03.724126 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:03.724042 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:03.801376 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:03.801337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:03.922197 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:03.922160 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:04.517118 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:04.517082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:04.924357 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:04.924271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:05.127779 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:05.127746 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:14.738673 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:14.738639 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:14.836671 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:14.836634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:14.899355 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:14.899317 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:16.970093 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:16.970053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:21:16.972558 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:16.972535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fea8725-773d-4fd0-a2ab-93a9b28b02cc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hrjzv\" (UID: \"7fea8725-773d-4fd0-a2ab-93a9b28b02cc\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:21:17.240672 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:17.240587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" Jun 11 15:21:17.399317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:17.399287 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv"] Jun 11 15:21:17.402685 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:17.402659 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fea8725_773d_4fd0_a2ab_93a9b28b02cc.slice/crio-012736bd722723d3bce1b1d59d110f0bdef2abde1a6fa51dfff0234b7070b476 WatchSource:0}: Error finding container 012736bd722723d3bce1b1d59d110f0bdef2abde1a6fa51dfff0234b7070b476: Status 404 returned error can't find the container with id 012736bd722723d3bce1b1d59d110f0bdef2abde1a6fa51dfff0234b7070b476 Jun 11 15:21:17.987430 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:17.987371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" event={"ID":"7fea8725-773d-4fd0-a2ab-93a9b28b02cc","Type":"ContainerStarted","Data":"012736bd722723d3bce1b1d59d110f0bdef2abde1a6fa51dfff0234b7070b476"} Jun 11 15:21:18.641399 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:18.641354 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mr68h" podUID="4acabfe7-e803-488f-addb-6f32b5e027dd" Jun 11 15:21:18.990762 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:18.990681 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:19.465245 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:19.465190 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:19.567775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:19.567737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:19.666741 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:19.666704 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:19.995429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:19.995394 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" event={"ID":"7fea8725-773d-4fd0-a2ab-93a9b28b02cc","Type":"ContainerStarted","Data":"2e9af96c916f3a3b109ed4720b40c4b487249bced0daf9a9065bb0cf3e5b3454"} Jun 11 15:21:20.015387 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:20.015333 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hrjzv" podStartSLOduration=33.262579762 podStartE2EDuration="35.015316909s" totalImagesPullingTime="1.752737147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:20.014515912 +0000 UTC m=+283.399713291" watchObservedRunningTime="2026-06-11 15:21:20.015316909 +0000 UTC m=+283.400514289" Jun 11 15:21:20.035274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:20.035213 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:21.185339 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.185304 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pt486"] Jun 11 15:21:21.187413 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.187396 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.191361 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.191336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:21:21.191484 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.191365 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fb8jz\"" Jun 11 15:21:21.191484 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.191392 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:21:21.202859 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.202834 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pt486"] Jun 11 15:21:21.297295 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.297261 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt"] Jun 11 15:21:21.299077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.299060 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79cc7d96c5-bghrj"] Jun 11 15:21:21.299200 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.299183 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:21.300900 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.300880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.301713 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.301697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 15:21:21.301825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.301800 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n6tbl\"" Jun 11 15:21:21.303306 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.303285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-data-volume\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.303411 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.303319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.303472 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.303414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfpnh\" (UniqueName: \"kubernetes.io/projected/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-api-access-jfpnh\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.303472 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.303438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.303576 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.303472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-crio-socket\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.308873 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.308845 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qw9jm\"" Jun 11 15:21:21.309077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.309062 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 15:21:21.309154 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.309106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 15:21:21.309264 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.309248 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 15:21:21.313536 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.313511 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt"] Jun 11 15:21:21.315134 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.315107 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 15:21:21.317066 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.317046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79cc7d96c5-bghrj"] Jun 11 15:21:21.347718 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.347687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:21.404572 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-data-volume\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.404572 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/285d9f31-f4bb-4b77-914d-cb8289193630-ca-trust-extracted\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.404800 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.404800 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-image-registry-private-configuration\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.404893 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404823 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-installation-pull-secrets\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.404956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnwqr\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-kube-api-access-jnwqr\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.404956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-data-volume\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405057 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.404958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55148c08-3191-4b9e-af1b-0f19182f9802-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5fbkt\" (UID: \"55148c08-3191-4b9e-af1b-0f19182f9802\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:21.405057 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-registry-certificates\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.405151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfpnh\" (UniqueName: \"kubernetes.io/projected/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-api-access-jfpnh\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405151 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405120 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-bound-sa-token\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.405310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-crio-socket\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405220 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-crio-socket\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.405310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405258 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-trusted-ca\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.405310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.405287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-registry-tls\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.407509 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.407491 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.414025 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.414004 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfpnh\" (UniqueName: \"kubernetes.io/projected/1c3a8a1f-9b00-417c-aa2b-db22a8886e31-kube-api-access-jfpnh\") pod \"insights-runtime-extractor-pt486\" (UID: \"1c3a8a1f-9b00-417c-aa2b-db22a8886e31\") " pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.437022 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.436957 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:21.496401 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.496373 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pt486" Jun 11 15:21:21.506664 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-image-registry-private-configuration\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.506822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-installation-pull-secrets\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.506822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506716 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnwqr\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-kube-api-access-jnwqr\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.506822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55148c08-3191-4b9e-af1b-0f19182f9802-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5fbkt\" (UID: \"55148c08-3191-4b9e-af1b-0f19182f9802\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:21.506822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-registry-certificates\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.506822 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-bound-sa-token\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.507069 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-trusted-ca\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.507069 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-registry-tls\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.507069 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.506906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/285d9f31-f4bb-4b77-914d-cb8289193630-ca-trust-extracted\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.507362 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.507271 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/285d9f31-f4bb-4b77-914d-cb8289193630-ca-trust-extracted\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.509787 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.508252 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-registry-certificates\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.509787 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.509372 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/285d9f31-f4bb-4b77-914d-cb8289193630-trusted-ca\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.510068 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.510045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55148c08-3191-4b9e-af1b-0f19182f9802-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5fbkt\" (UID: \"55148c08-3191-4b9e-af1b-0f19182f9802\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:21.510606 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.510566 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-registry-tls\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.510889 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.510867 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-installation-pull-secrets\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.512049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.512013 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/285d9f31-f4bb-4b77-914d-cb8289193630-image-registry-private-configuration\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.515047 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.515026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnwqr\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-kube-api-access-jnwqr\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.515565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.515536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/285d9f31-f4bb-4b77-914d-cb8289193630-bound-sa-token\") pod \"image-registry-79cc7d96c5-bghrj\" (UID: \"285d9f31-f4bb-4b77-914d-cb8289193630\") " pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.609609 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.609574 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:21.615871 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.615842 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:21.635622 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.635594 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pt486"] Jun 11 15:21:21.639415 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:21.639380 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3a8a1f_9b00_417c_aa2b_db22a8886e31.slice/crio-57522fbf0ae5c2a266232d5d8a652578ae9f2b7710eb0b6cf28aab01d60e52aa WatchSource:0}: Error finding container 57522fbf0ae5c2a266232d5d8a652578ae9f2b7710eb0b6cf28aab01d60e52aa: Status 404 returned error can't find the container with id 57522fbf0ae5c2a266232d5d8a652578ae9f2b7710eb0b6cf28aab01d60e52aa Jun 11 15:21:21.778780 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.778610 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt"] Jun 11 15:21:21.781134 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:21.781113 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55148c08_3191_4b9e_af1b_0f19182f9802.slice/crio-f6ece9e1406a96c243dff9f17aa0a3384aa5b49dde667a59b1b015977d0fb99d WatchSource:0}: Error finding container f6ece9e1406a96c243dff9f17aa0a3384aa5b49dde667a59b1b015977d0fb99d: Status 404 returned error can't find the container with id f6ece9e1406a96c243dff9f17aa0a3384aa5b49dde667a59b1b015977d0fb99d Jun 11 15:21:21.796478 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:21.796457 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79cc7d96c5-bghrj"] Jun 11 15:21:21.798572 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:21.798543 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285d9f31_f4bb_4b77_914d_cb8289193630.slice/crio-7bf3d8fde034e257c1c80d42551655720dc74d4172f3879bd73fd0d715d027ad WatchSource:0}: Error finding container 7bf3d8fde034e257c1c80d42551655720dc74d4172f3879bd73fd0d715d027ad: Status 404 returned error can't find the container with id 7bf3d8fde034e257c1c80d42551655720dc74d4172f3879bd73fd0d715d027ad Jun 11 15:21:22.003811 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.003774 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" event={"ID":"285d9f31-f4bb-4b77-914d-cb8289193630","Type":"ContainerStarted","Data":"666b43ad5c912201b20654b489744166c307c7a3e700b3d3a9d9c751396cf94f"} Jun 11 15:21:22.003996 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.003822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" event={"ID":"285d9f31-f4bb-4b77-914d-cb8289193630","Type":"ContainerStarted","Data":"7bf3d8fde034e257c1c80d42551655720dc74d4172f3879bd73fd0d715d027ad"} Jun 11 15:21:22.003996 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.003871 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:22.005289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.005261 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pt486" event={"ID":"1c3a8a1f-9b00-417c-aa2b-db22a8886e31","Type":"ContainerStarted","Data":"50cb42477f250484875d3fe51c616169c303309bb820c504e78193030126db7a"} Jun 11 15:21:22.005426 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.005309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pt486" event={"ID":"1c3a8a1f-9b00-417c-aa2b-db22a8886e31","Type":"ContainerStarted","Data":"57522fbf0ae5c2a266232d5d8a652578ae9f2b7710eb0b6cf28aab01d60e52aa"} Jun 11 15:21:22.006384 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.006358 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" event={"ID":"55148c08-3191-4b9e-af1b-0f19182f9802","Type":"ContainerStarted","Data":"f6ece9e1406a96c243dff9f17aa0a3384aa5b49dde667a59b1b015977d0fb99d"} Jun 11 15:21:22.028092 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.028045 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" podStartSLOduration=1.028030837 podStartE2EDuration="1.028030837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:22.027424117 +0000 UTC m=+285.412621519" watchObservedRunningTime="2026-06-11 15:21:22.028030837 +0000 UTC m=+285.413228215" Jun 11 15:21:22.514949 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.514914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:22.517646 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.517621 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4acabfe7-e803-488f-addb-6f32b5e027dd-metrics-tls\") pod \"dns-default-mr68h\" (UID: \"4acabfe7-e803-488f-addb-6f32b5e027dd\") " pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:22.594285 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.594183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mfhrn\"" Jun 11 15:21:22.601829 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.601794 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:22.606030 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.605910 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:22.681376 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.681333 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:22.902801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:22.902775 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mr68h"] Jun 11 15:21:22.905685 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:22.905657 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acabfe7_e803_488f_addb_6f32b5e027dd.slice/crio-e2b3e020e58cd0e5d24ed8eb9b0b5a9906ff3fd56e86e73c65caec986065950f WatchSource:0}: Error finding container e2b3e020e58cd0e5d24ed8eb9b0b5a9906ff3fd56e86e73c65caec986065950f: Status 404 returned error can't find the container with id e2b3e020e58cd0e5d24ed8eb9b0b5a9906ff3fd56e86e73c65caec986065950f Jun 11 15:21:23.014934 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.014897 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:23.016305 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.016266 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pt486" event={"ID":"1c3a8a1f-9b00-417c-aa2b-db22a8886e31","Type":"ContainerStarted","Data":"71bd56e28d9a69beef6ff529e00c689c89c715ac4a03a9d2e87194043971fe65"} Jun 11 15:21:23.018106 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.018079 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" event={"ID":"55148c08-3191-4b9e-af1b-0f19182f9802","Type":"ContainerStarted","Data":"e0d3dd0382dbfc5b1f759442610d91befb7deb3a6c7d4a439933a8d6b80be996"} Jun 11 15:21:23.018336 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.018282 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:23.019890 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.019861 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr68h" event={"ID":"4acabfe7-e803-488f-addb-6f32b5e027dd","Type":"ContainerStarted","Data":"e2b3e020e58cd0e5d24ed8eb9b0b5a9906ff3fd56e86e73c65caec986065950f"} Jun 11 15:21:23.024333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.024302 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" Jun 11 15:21:23.035847 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.035802 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5fbkt" podStartSLOduration=0.991504397 podStartE2EDuration="2.035789248s" totalImagesPullingTime="1.044284851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:23.034264319 +0000 UTC m=+286.419461698" watchObservedRunningTime="2026-06-11 15:21:23.035789248 +0000 UTC m=+286.420986659" Jun 11 15:21:23.114240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.114148 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:23.670402 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.670369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:23.759689 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.759654 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:23.832052 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:23.832021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:24.024956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:24.024916 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pt486" event={"ID":"1c3a8a1f-9b00-417c-aa2b-db22a8886e31","Type":"ContainerStarted","Data":"71daf30b9ec0510e3b13733dce7ee4b1031272d57c568f363bd26166cf127208"} Jun 11 15:21:24.043777 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:24.043723 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pt486" podStartSLOduration=0.988119807 podStartE2EDuration="3.043709368s" totalImagesPullingTime="2.055589561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:21:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:24.042595649 +0000 UTC m=+287.427793026" watchObservedRunningTime="2026-06-11 15:21:24.043709368 +0000 UTC m=+287.428906745" Jun 11 15:21:25.646936 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:25.646899 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:26.033959 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.033925 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr68h" event={"ID":"4acabfe7-e803-488f-addb-6f32b5e027dd","Type":"ContainerStarted","Data":"30975dc90c8a2c5bcbf1ac5326a901a0cf055c1bbb0ecb4ca7815eaa14c732c0"} Jun 11 15:21:26.034105 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.033980 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr68h" event={"ID":"4acabfe7-e803-488f-addb-6f32b5e027dd","Type":"ContainerStarted","Data":"a1577e144893850a99a939927720bd92e72403022bae2b368d60ec4bc9748076"} Jun 11 15:21:26.034105 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.034009 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:26.056305 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.056256 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mr68h" podStartSLOduration=251.741321636 podStartE2EDuration="4m14.056239539s" totalImagesPullingTime="2.314917903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:26.055198093 +0000 UTC m=+289.440395472" watchObservedRunningTime="2026-06-11 15:21:26.056239539 +0000 UTC m=+289.441436922" Jun 11 15:21:26.133938 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.133906 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:26.242115 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:26.242082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:27.792142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:27.792085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:27.891437 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:27.891401 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.006482 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.006445 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.064559 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.064485 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cfncd"] Jun 11 15:21:28.069367 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.069342 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.072383 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.072361 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9t5dk\"" Jun 11 15:21:28.073142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.073123 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:21:28.073450 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.073434 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:21:28.073863 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.073835 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:21:28.076036 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.076014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:21:28.115427 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.115379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.209824 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.209779 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.260820 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260779 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-textfile\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-sys\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-metrics-client-ca\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.260968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-tls\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261298 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.261026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-wtmp\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261298 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.261071 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-root\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.261298 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.261094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nsdj\" (UniqueName: \"kubernetes.io/projected/f2619a52-677f-4ce2-8341-20ae2cddf0aa-kube-api-access-2nsdj\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.320327 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.320210 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.362320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-tls\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362483 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-wtmp\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362483 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-root\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362483 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsdj\" (UniqueName: \"kubernetes.io/projected/f2619a52-677f-4ce2-8341-20ae2cddf0aa-kube-api-access-2nsdj\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362483 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-textfile\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362510 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-wtmp\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362515 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-root\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362540 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-sys\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.362702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-metrics-client-ca\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.363025 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362867 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-textfile\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.363025 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.362872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2619a52-677f-4ce2-8341-20ae2cddf0aa-sys\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.363247 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.363210 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-metrics-client-ca\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.363456 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.363434 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.365063 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.365044 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-tls\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.365254 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.365216 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2619a52-677f-4ce2-8341-20ae2cddf0aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.370446 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.370421 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nsdj\" (UniqueName: \"kubernetes.io/projected/f2619a52-677f-4ce2-8341-20ae2cddf0aa-kube-api-access-2nsdj\") pod \"node-exporter-cfncd\" (UID: \"f2619a52-677f-4ce2-8341-20ae2cddf0aa\") " pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.379360 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.379337 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfncd" Jun 11 15:21:28.392010 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:28.391962 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2619a52_677f_4ce2_8341_20ae2cddf0aa.slice/crio-6a8002c0f02344c56dc9b6d65ebbbf1b9ce366e9aac49b84be7684bcbd036fd7 WatchSource:0}: Error finding container 6a8002c0f02344c56dc9b6d65ebbbf1b9ce366e9aac49b84be7684bcbd036fd7: Status 404 returned error can't find the container with id 6a8002c0f02344c56dc9b6d65ebbbf1b9ce366e9aac49b84be7684bcbd036fd7 Jun 11 15:21:28.421273 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.421243 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.520172 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.520135 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:28.620435 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:28.620342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:29.046742 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.046702 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfncd" event={"ID":"f2619a52-677f-4ce2-8341-20ae2cddf0aa","Type":"ContainerStarted","Data":"6a8002c0f02344c56dc9b6d65ebbbf1b9ce366e9aac49b84be7684bcbd036fd7"} Jun 11 15:21:29.050961 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.050930 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:29.145621 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.145589 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:21:29.148955 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.148938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.151679 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151652 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:21:29.151839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151692 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:21:29.151839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151652 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:21:29.151959 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151943 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:21:29.152020 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151955 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s2hpl\"" Jun 11 15:21:29.152020 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.151993 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:21:29.152269 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.152246 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:21:29.152522 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.152323 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:21:29.152522 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.152340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:21:29.152522 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.152368 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:21:29.157076 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.157046 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:29.168775 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.168873 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.168873 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.168956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.168956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168932 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.168993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169087 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169087 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snd77\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.169309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.169251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.181326 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.181290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:21:29.269786 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.269762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.269911 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.269801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.269911 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.269825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.269911 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.269854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.269911 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.269879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270111 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:29.269950 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle podName:94eabab4-2e64-4053-b1ed-e6e48ab08bcf nodeName:}" failed. No retries permitted until 2026-06-11 15:21:29.769926757 +0000 UTC m=+293.155124114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf") : configmap references non-existent config key: ca-bundle.crt Jun 11 15:21:29.270111 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270111 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270111 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270111 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:29.270105 2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:29.270161 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls podName:94eabab4-2e64-4053-b1ed-e6e48ab08bcf nodeName:}" failed. No retries permitted until 2026-06-11 15:21:29.770142647 +0000 UTC m=+293.155340008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf") : secret "alertmanager-main-tls" not found Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.270352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snd77\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.271127 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.270911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.272211 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.272161 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.273407 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.273379 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.273964 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.273938 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.274768 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.274743 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.274861 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.274801 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.275113 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.275091 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.275580 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.275548 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.276165 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.276143 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.276760 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.276742 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.278537 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.278509 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snd77\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.559146 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.559103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:29.773669 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.773634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.773863 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.773695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.774406 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.774387 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:29.776287 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:29.776265 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:30.051683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:30.051605 2582 generic.go:356] "Generic (PLEG): container finished" podID="f2619a52-677f-4ce2-8341-20ae2cddf0aa" containerID="d61668e2193fcf19eac91a6a27eee0886135677f329299fb6eb8278501dcde35" exitCode=0 Jun 11 15:21:30.051683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:30.051670 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfncd" event={"ID":"f2619a52-677f-4ce2-8341-20ae2cddf0aa","Type":"ContainerDied","Data":"d61668e2193fcf19eac91a6a27eee0886135677f329299fb6eb8278501dcde35"} Jun 11 15:21:30.061893 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:30.061868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:21:30.234615 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:30.234480 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:21:30.239196 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:30.239168 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94eabab4_2e64_4053_b1ed_e6e48ab08bcf.slice/crio-b171f12600b542301bd56005a105225dd683c9852fd1d53197bbfb0755e71ae0 WatchSource:0}: Error finding container b171f12600b542301bd56005a105225dd683c9852fd1d53197bbfb0755e71ae0: Status 404 returned error can't find the container with id b171f12600b542301bd56005a105225dd683c9852fd1d53197bbfb0755e71ae0 Jun 11 15:21:31.023684 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.023627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:31.057848 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.057774 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"b171f12600b542301bd56005a105225dd683c9852fd1d53197bbfb0755e71ae0"} Jun 11 15:21:31.061264 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.061216 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfncd" event={"ID":"f2619a52-677f-4ce2-8341-20ae2cddf0aa","Type":"ContainerStarted","Data":"e1c6eecb9db52d10452bf82dfa61327b0eb0a6ef144ff813830db0a253a22e15"} Jun 11 15:21:31.061395 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.061289 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfncd" event={"ID":"f2619a52-677f-4ce2-8341-20ae2cddf0aa","Type":"ContainerStarted","Data":"d5a7396f3965724d3b653991da7ef22ab6b08f5d7d54d0e3eef8ee197b8059e9"} Jun 11 15:21:31.087044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.086987 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cfncd" podStartSLOduration=2.217574593 podStartE2EDuration="3.086972055s" totalImagesPullingTime="792.607471ms" totalInitContainerRuntime="76.789991ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:31.085483305 +0000 UTC m=+294.470680712" watchObservedRunningTime="2026-06-11 15:21:31.086972055 +0000 UTC m=+294.472169487" Jun 11 15:21:31.100973 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.100917 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:31.162081 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.162033 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79c9b85f5b-2v67h"] Jun 11 15:21:31.166157 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.166136 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.169049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.168776 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 15:21:31.169049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.168818 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v8xnl\"" Jun 11 15:21:31.169049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.168934 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 15:21:31.169049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.169000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 15:21:31.169468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.169110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 15:21:31.169468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.169187 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4tsnbu2dgqf1k\"" Jun 11 15:21:31.169468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.169325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 15:21:31.179419 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.179392 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79c9b85f5b-2v67h"] Jun 11 15:21:31.188815 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.188786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.188968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.188856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-grpc-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.188968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.188889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.188968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.188913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-metrics-client-ca\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.188968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.188959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7sn\" (UniqueName: \"kubernetes.io/projected/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-kube-api-access-jp7sn\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.189193 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.189007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.189193 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.189050 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.189193 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.189091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290177 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290177 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-grpc-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-metrics-client-ca\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290915 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7sn\" (UniqueName: \"kubernetes.io/projected/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-kube-api-access-jp7sn\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290915 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.290915 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.291238 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.290946 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-metrics-client-ca\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.293364 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.293318 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-grpc-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.293959 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.293900 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.293959 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.293920 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-tls\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.294596 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.294572 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.294696 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.294648 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.294696 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.294689 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.308103 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.308067 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:31.316706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.316680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7sn\" (UniqueName: \"kubernetes.io/projected/92f0b4ad-c1bc-46da-af4a-63d8bc50cbde-kube-api-access-jp7sn\") pod \"thanos-querier-79c9b85f5b-2v67h\" (UID: \"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde\") " pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.479420 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.479384 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:31.485530 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.485501 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:31.623757 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:31.623733 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79c9b85f5b-2v67h"] Jun 11 15:21:31.626209 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:31.626180 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f0b4ad_c1bc_46da_af4a_63d8bc50cbde.slice/crio-99c3e8854ccb664e65408b24e93a280db2f5d497af85f290f1b4c06d8ca59939 WatchSource:0}: Error finding container 99c3e8854ccb664e65408b24e93a280db2f5d497af85f290f1b4c06d8ca59939: Status 404 returned error can't find the container with id 99c3e8854ccb664e65408b24e93a280db2f5d497af85f290f1b4c06d8ca59939 Jun 11 15:21:32.066763 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.066730 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577" exitCode=0 Jun 11 15:21:32.067217 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.066820 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577"} Jun 11 15:21:32.068059 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.068032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"99c3e8854ccb664e65408b24e93a280db2f5d497af85f290f1b4c06d8ca59939"} Jun 11 15:21:32.156626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.156585 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:32.257863 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.257825 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:32.828135 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:32.828006 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:33.337004 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:33.336964 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:34.067322 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:21:34.067289 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-crdqt" podUID="b359b556-ed0c-45db-b6a9-0e23e66c8456" Jun 11 15:21:34.077288 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.077258 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a"} Jun 11 15:21:34.077406 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.077349 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a"} Jun 11 15:21:34.078994 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.078966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"bc09cac983893bb56cba70f2b92e518ea3b9182ac3b6b55d3b0a7e1f29df613a"} Jun 11 15:21:34.079082 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.079025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"5b7adb65cadde34aba95f9e6095c776c150c50498f18a23bcc33d5490211cf1a"} Jun 11 15:21:34.340585 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.340550 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:34.345648 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.345623 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:21:34.349388 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.349371 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.351979 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.351956 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:21:34.352113 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352092 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:21:34.352255 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352237 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:21:34.352313 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352301 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:21:34.352586 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352548 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c9mjw\"" Jun 11 15:21:34.352586 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352550 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:21:34.352853 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352786 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:21:34.352853 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.352793 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:21:34.353043 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353025 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:21:34.353209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353143 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:21:34.353209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353178 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:21:34.353209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:21:34.353209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353189 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:21:34.353693 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353339 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fod7cpeit10u4\"" Jun 11 15:21:34.353693 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353352 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:21:34.353693 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.353360 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:21:34.354950 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.354934 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:21:34.368415 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.368390 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:21:34.420890 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.420890 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.420890 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420932 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc6w4\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.420984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421273 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421329 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421602 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421602 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421602 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.421602 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.421470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522529 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522529 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522773 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522773 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522773 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.522773 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523031 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.522967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523675 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523702 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc6w4\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523841 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.523878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.524275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.524275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.524275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.524445 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.524428 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.524499 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.524470 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.525195 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.525169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.527958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.527443 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.527958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.527674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.527958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.523700 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.527958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.527912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.527958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.527912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528323 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528060 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528323 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528064 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528433 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528336 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528433 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528542 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528460 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528793 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528776 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.528841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.528820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.529480 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.529460 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.533451 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.533434 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc6w4\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4\") pod \"prometheus-k8s-0\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.659806 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.659749 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:34.837119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:34.837093 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:21:34.953201 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:21:34.953163 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc857b87b_833c_4c21_a498_fdd2fb2ca962.slice/crio-8f5dac1e954e8f9bb096adbddaee63d168a4b88397e5322d4be068b9de8fdae2 WatchSource:0}: Error finding container 8f5dac1e954e8f9bb096adbddaee63d168a4b88397e5322d4be068b9de8fdae2: Status 404 returned error can't find the container with id 8f5dac1e954e8f9bb096adbddaee63d168a4b88397e5322d4be068b9de8fdae2 Jun 11 15:21:35.085201 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.085176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} Jun 11 15:21:35.085369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.085253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"8f5dac1e954e8f9bb096adbddaee63d168a4b88397e5322d4be068b9de8fdae2"} Jun 11 15:21:35.094830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.094804 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"549094c7384744fdc4f24d580e06782fdf1dd7899fd3fba0744b64f5b49c9a91"} Jun 11 15:21:35.094931 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.094906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"5f6df42846a36611228c7303a9443b1730234a6f7c48cd68b271645cda8d3f24"} Jun 11 15:21:35.098494 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.098469 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6"} Jun 11 15:21:35.098598 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.098542 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3"} Jun 11 15:21:35.098598 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.098584 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64"} Jun 11 15:21:35.098675 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.098630 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerStarted","Data":"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a"} Jun 11 15:21:35.142945 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.142893 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.469627898 podStartE2EDuration="6.142877204s" totalImagesPullingTime="3.65412499s" totalInitContainerRuntime="19.124316ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:35.141726952 +0000 UTC m=+298.526924329" watchObservedRunningTime="2026-06-11 15:21:35.142877204 +0000 UTC m=+298.528074581" Jun 11 15:21:35.267059 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.266966 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:35.368719 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:35.368678 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:36.040145 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.040117 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mr68h" Jun 11 15:21:36.105421 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.105383 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" exitCode=0 Jun 11 15:21:36.105605 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.105478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} Jun 11 15:21:36.108845 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.108817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"dce4731240661a6d246678bdf58e08ae3c5c0e4860f01062d6c7a628a6d13162"} Jun 11 15:21:36.108938 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.108880 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" event={"ID":"92f0b4ad-c1bc-46da-af4a-63d8bc50cbde","Type":"ContainerStarted","Data":"efe726797f8d34e24aad556affda9dd8d41bd47dd32d6b3f898d327af7a210ce"} Jun 11 15:21:36.109191 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.109170 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:36.188090 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.187982 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" podStartSLOduration=2.005318353 podStartE2EDuration="5.187965751s" totalImagesPullingTime="3.182647398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:36.186901507 +0000 UTC m=+299.572098884" watchObservedRunningTime="2026-06-11 15:21:36.187965751 +0000 UTC m=+299.573163175" Jun 11 15:21:36.226146 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.226110 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:36.293911 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:36.293873 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:37.036695 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:37.036665 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:21:37.037149 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:37.036934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:21:37.040210 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:37.040190 2582 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:21:40.128459 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128415 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} Jun 11 15:21:40.129049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128534 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} Jun 11 15:21:40.129049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128601 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} Jun 11 15:21:40.129049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128637 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} Jun 11 15:21:40.129049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} Jun 11 15:21:40.129049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.128718 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerStarted","Data":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} Jun 11 15:21:40.162548 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.162495 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.113999167 podStartE2EDuration="6.162479703s" totalImagesPullingTime="3.028248617s" totalInitContainerRuntime="20.231919ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:40.160625132 +0000 UTC m=+303.545822511" watchObservedRunningTime="2026-06-11 15:21:40.162479703 +0000 UTC m=+303.547677118" Jun 11 15:21:40.386463 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.386364 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:40.487742 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.487705 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:40.588666 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.588634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:40.688679 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.688573 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:40.878903 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:40.878863 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:41.085150 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:41.085105 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:41.481673 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:41.481581 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:41.574976 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:41.574941 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:42.120539 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:42.120515 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79c9b85f5b-2v67h" Jun 11 15:21:42.275393 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:42.275350 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:42.475661 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:42.475576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:42.639022 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:42.638980 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:42.740277 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:42.740161 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:43.024106 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:43.024082 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79cc7d96c5-bghrj" Jun 11 15:21:43.163032 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:43.162995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:43.237326 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:43.237296 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:43.369807 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:43.369712 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:43.462562 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:43.462526 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:44.660788 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:44.660737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:21:44.835750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:44.835691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:44.936479 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:44.936380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:48.066665 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:48.066630 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:21:48.266565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:48.266527 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:48.367472 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:48.367385 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:53.904727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:53.904688 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:54.002995 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:54.002955 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:55.186744 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:55.186711 2582 generic.go:356] "Generic (PLEG): container finished" podID="71427ad7-8f03-4ce1-8272-2014c07a79b1" containerID="65766d5aedf94d5aa4901b9a0066f151e0c7c55b7c4c8dfd6cecd866d0028d1f" exitCode=0 Jun 11 15:21:55.187127 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:55.186781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" event={"ID":"71427ad7-8f03-4ce1-8272-2014c07a79b1","Type":"ContainerDied","Data":"65766d5aedf94d5aa4901b9a0066f151e0c7c55b7c4c8dfd6cecd866d0028d1f"} Jun 11 15:21:55.187127 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:55.187073 2582 scope.go:117] "RemoveContainer" containerID="65766d5aedf94d5aa4901b9a0066f151e0c7c55b7c4c8dfd6cecd866d0028d1f" Jun 11 15:21:56.192113 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:56.192083 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6p5n4" event={"ID":"71427ad7-8f03-4ce1-8272-2014c07a79b1","Type":"ContainerStarted","Data":"1a2ad133ee536bee507dc2d06c73160db9c5b2b27a032f1cb7df6b92b51155fd"} Jun 11 15:21:57.264949 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:57.264918 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:57.504790 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:57.504760 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:57.604477 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:57.604393 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:59.842633 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:59.842589 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:59.943025 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:21:59.942984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:03.112006 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:03.111970 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:03.182601 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:03.182569 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:04.224910 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:04.224877 2582 generic.go:356] "Generic (PLEG): container finished" podID="424b4b65-0e4c-4112-9535-9482a6641cc3" containerID="f4888be171bf8261dd6dc19438f55903042c7b649932492ad2a35e3aa532cf22" exitCode=0 Jun 11 15:22:04.225320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:04.224948 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wvbs5" event={"ID":"424b4b65-0e4c-4112-9535-9482a6641cc3","Type":"ContainerDied","Data":"f4888be171bf8261dd6dc19438f55903042c7b649932492ad2a35e3aa532cf22"} Jun 11 15:22:04.225320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:04.225288 2582 scope.go:117] "RemoveContainer" containerID="f4888be171bf8261dd6dc19438f55903042c7b649932492ad2a35e3aa532cf22" Jun 11 15:22:05.230569 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:05.230532 2582 generic.go:356] "Generic (PLEG): container finished" podID="6165b866-1b23-4d51-a2c3-0313574aa02f" containerID="2b069ec8f56b7dd6ebc0a5c02da807ee4751ccce93274a989fe6dd6cd1b35e0b" exitCode=0 Jun 11 15:22:05.230982 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:05.230612 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" event={"ID":"6165b866-1b23-4d51-a2c3-0313574aa02f","Type":"ContainerDied","Data":"2b069ec8f56b7dd6ebc0a5c02da807ee4751ccce93274a989fe6dd6cd1b35e0b"} Jun 11 15:22:05.231073 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:05.231003 2582 scope.go:117] "RemoveContainer" containerID="2b069ec8f56b7dd6ebc0a5c02da807ee4751ccce93274a989fe6dd6cd1b35e0b" Jun 11 15:22:05.232540 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:05.232519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wvbs5" event={"ID":"424b4b65-0e4c-4112-9535-9482a6641cc3","Type":"ContainerStarted","Data":"9246ab2eedff3810d5782dec389a64543dc77135542f6a11f018fc50c0b3e716"} Jun 11 15:22:06.237771 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:06.237733 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-55kw2" event={"ID":"6165b866-1b23-4d51-a2c3-0313574aa02f","Type":"ContainerStarted","Data":"567d5cff82889643b9c560cb535a35cf7b18316d6a2af144e7b3f8f60faaefca"} Jun 11 15:22:07.672069 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:07.672022 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:07.741722 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:07.741685 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:08.244574 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:08.244540 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:08.345185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:08.345155 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:08.446166 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:08.446125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:08.738214 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:08.738116 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:08.833834 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:08.833792 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:21.489836 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:21.489802 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:21.590176 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:21.590130 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:21.652311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:21.652279 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:29.841325 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:29.841215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:29.943757 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:29.943725 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:32.272695 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:32.272663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:32.389248 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:32.381668 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:34.660899 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:34.660858 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:34.682474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:34.682448 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:35.364649 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:35.364620 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:43.291737 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:43.291667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:43.358392 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:43.358346 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:47.359275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:47.359205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:47.660375 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:47.660250 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:48.420759 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.420724 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421007 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="alertmanager" containerID="cri-o://a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" gracePeriod=120 Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421094 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="prom-label-proxy" containerID="cri-o://41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" gracePeriod=120 Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421084 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-metric" containerID="cri-o://90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" gracePeriod=120 Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421136 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-web" containerID="cri-o://0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" gracePeriod=120 Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421154 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="config-reloader" containerID="cri-o://449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" gracePeriod=120 Jun 11 15:22:48.421258 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:48.421171 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy" containerID="cri-o://7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" gracePeriod=120 Jun 11 15:22:49.412701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412670 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" exitCode=0 Jun 11 15:22:49.412701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412693 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" exitCode=0 Jun 11 15:22:49.412701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412700 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" exitCode=0 Jun 11 15:22:49.412991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412709 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" exitCode=0 Jun 11 15:22:49.412991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6"} Jun 11 15:22:49.412991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412801 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64"} Jun 11 15:22:49.412991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a"} Jun 11 15:22:49.412991 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.412850 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a"} Jun 11 15:22:49.672019 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.671955 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:49.815727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815688 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815733 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snd77\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815756 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815795 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815824 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815846 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815869 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.815951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815930 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815957 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.815990 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.816032 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.816060 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.816100 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca\") pod \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\" (UID: \"94eabab4-2e64-4053-b1ed-e6e48ab08bcf\") " Jun 11 15:22:49.816760 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.816693 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:49.816952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.816900 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:49.818815 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.818772 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:22:49.819124 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.819096 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.819415 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.819262 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:49.819748 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.819619 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77" (OuterVolumeSpecName: "kube-api-access-snd77") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "kube-api-access-snd77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:49.819748 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.819720 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume" (OuterVolumeSpecName: "config-volume") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.819892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.819817 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.820367 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.820346 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.820932 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.820912 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.821052 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.821036 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out" (OuterVolumeSpecName: "config-out") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:22:49.824345 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.824210 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.830418 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.830398 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config" (OuterVolumeSpecName: "web-config") pod "94eabab4-2e64-4053-b1ed-e6e48ab08bcf" (UID: "94eabab4-2e64-4053-b1ed-e6e48ab08bcf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:49.917801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917750 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.917801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917793 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.917801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917803 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-out\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.917801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917812 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-config-volume\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917821 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917830 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-metrics-client-ca\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917838 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-web-config\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917846 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snd77\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-kube-api-access-snd77\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917854 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-secret-alertmanager-main-tls\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917861 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-tls-assets\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917869 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-cluster-tls-config\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917877 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:49.918109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:49.917884 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94eabab4-2e64-4053-b1ed-e6e48ab08bcf-alertmanager-main-db\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:50.420071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420034 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" exitCode=0 Jun 11 15:22:50.420071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420065 2582 generic.go:356] "Generic (PLEG): container finished" podID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerID="0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" exitCode=0 Jun 11 15:22:50.420350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420122 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.420350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3"} Jun 11 15:22:50.420350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420220 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a"} Jun 11 15:22:50.420350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420253 2582 scope.go:117] "RemoveContainer" containerID="41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" Jun 11 15:22:50.420350 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.420270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94eabab4-2e64-4053-b1ed-e6e48ab08bcf","Type":"ContainerDied","Data":"b171f12600b542301bd56005a105225dd683c9852fd1d53197bbfb0755e71ae0"} Jun 11 15:22:50.428465 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.428444 2582 scope.go:117] "RemoveContainer" containerID="90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" Jun 11 15:22:50.436033 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.436015 2582 scope.go:117] "RemoveContainer" containerID="7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" Jun 11 15:22:50.443974 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.443950 2582 scope.go:117] "RemoveContainer" containerID="0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" Jun 11 15:22:50.445030 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.444990 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:50.447665 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.447645 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:50.451586 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.451568 2582 scope.go:117] "RemoveContainer" containerID="449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" Jun 11 15:22:50.458849 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.458827 2582 scope.go:117] "RemoveContainer" containerID="a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" Jun 11 15:22:50.466508 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.466490 2582 scope.go:117] "RemoveContainer" containerID="797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577" Jun 11 15:22:50.474104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474088 2582 scope.go:117] "RemoveContainer" containerID="41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" Jun 11 15:22:50.474418 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.474391 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6\": container with ID starting with 41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6 not found: ID does not exist" containerID="41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" Jun 11 15:22:50.474486 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474431 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6"} err="failed to get container status \"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6\": rpc error: code = NotFound desc = could not find container \"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6\": container with ID starting with 41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6 not found: ID does not exist" Jun 11 15:22:50.474486 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474474 2582 scope.go:117] "RemoveContainer" containerID="90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" Jun 11 15:22:50.474579 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474562 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:50.474698 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.474677 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3\": container with ID starting with 90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3 not found: ID does not exist" containerID="90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" Jun 11 15:22:50.474797 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474706 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3"} err="failed to get container status \"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3\": rpc error: code = NotFound desc = could not find container \"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3\": container with ID starting with 90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3 not found: ID does not exist" Jun 11 15:22:50.474797 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474726 2582 scope.go:117] "RemoveContainer" containerID="7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" Jun 11 15:22:50.474926 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.474908 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64\": container with ID starting with 7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64 not found: ID does not exist" containerID="7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" Jun 11 15:22:50.474980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474933 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64"} err="failed to get container status \"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64\": rpc error: code = NotFound desc = could not find container \"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64\": container with ID starting with 7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64 not found: ID does not exist" Jun 11 15:22:50.474980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474950 2582 scope.go:117] "RemoveContainer" containerID="0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" Jun 11 15:22:50.474980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474962 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="config-reloader" Jun 11 15:22:50.474980 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474973 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="config-reloader" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474986 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="alertmanager" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474991 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="alertmanager" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.474997 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-web" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475003 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-web" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475010 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475018 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475035 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-metric" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475040 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-metric" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475049 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="init-config-reloader" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475057 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="init-config-reloader" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475065 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="prom-label-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475071 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="prom-label-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475127 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475136 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="prom-label-proxy" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475144 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="config-reloader" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475149 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-metric" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475154 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="kube-rbac-proxy-web" Jun 11 15:22:50.475161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475161 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" containerName="alertmanager" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.475196 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a\": container with ID starting with 0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a not found: ID does not exist" containerID="0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475219 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a"} err="failed to get container status \"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a\": rpc error: code = NotFound desc = could not find container \"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a\": container with ID starting with 0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a not found: ID does not exist" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475266 2582 scope.go:117] "RemoveContainer" containerID="449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.475528 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a\": container with ID starting with 449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a not found: ID does not exist" containerID="449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475557 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a"} err="failed to get container status \"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a\": rpc error: code = NotFound desc = could not find container \"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a\": container with ID starting with 449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a not found: ID does not exist" Jun 11 15:22:50.475750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475577 2582 scope.go:117] "RemoveContainer" containerID="a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" Jun 11 15:22:50.475960 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.475844 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a\": container with ID starting with a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a not found: ID does not exist" containerID="a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" Jun 11 15:22:50.475960 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475865 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a"} err="failed to get container status \"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a\": rpc error: code = NotFound desc = could not find container \"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a\": container with ID starting with a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a not found: ID does not exist" Jun 11 15:22:50.475960 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.475880 2582 scope.go:117] "RemoveContainer" containerID="797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577" Jun 11 15:22:50.476123 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:50.476108 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577\": container with ID starting with 797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577 not found: ID does not exist" containerID="797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577" Jun 11 15:22:50.476333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476124 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577"} err="failed to get container status \"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577\": rpc error: code = NotFound desc = could not find container \"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577\": container with ID starting with 797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577 not found: ID does not exist" Jun 11 15:22:50.476333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476136 2582 scope.go:117] "RemoveContainer" containerID="41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6" Jun 11 15:22:50.476427 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476393 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6"} err="failed to get container status \"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6\": rpc error: code = NotFound desc = could not find container \"41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6\": container with ID starting with 41a4c71aa578f4db5a526884a2a1b31058cf8b4991ed6aa2617f6854085778f6 not found: ID does not exist" Jun 11 15:22:50.476427 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476416 2582 scope.go:117] "RemoveContainer" containerID="90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3" Jun 11 15:22:50.476638 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476620 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3"} err="failed to get container status \"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3\": rpc error: code = NotFound desc = could not find container \"90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3\": container with ID starting with 90406e1338b9825de8469d8577f270141f835ba61ff508291301f96e8f61b7b3 not found: ID does not exist" Jun 11 15:22:50.476704 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476638 2582 scope.go:117] "RemoveContainer" containerID="7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64" Jun 11 15:22:50.476866 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476846 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64"} err="failed to get container status \"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64\": rpc error: code = NotFound desc = could not find container \"7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64\": container with ID starting with 7ab113f5eb18700dbea5c11a89f0952c0c0ec991564809a333b48cbbe527cb64 not found: ID does not exist" Jun 11 15:22:50.476915 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.476866 2582 scope.go:117] "RemoveContainer" containerID="0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a" Jun 11 15:22:50.477104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477084 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a"} err="failed to get container status \"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a\": rpc error: code = NotFound desc = could not find container \"0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a\": container with ID starting with 0b69d1f5522678ec19f6e286d7871cc3c16a333b7a7fc4285cb43a192d534f0a not found: ID does not exist" Jun 11 15:22:50.477146 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477106 2582 scope.go:117] "RemoveContainer" containerID="449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a" Jun 11 15:22:50.477343 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477324 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a"} err="failed to get container status \"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a\": rpc error: code = NotFound desc = could not find container \"449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a\": container with ID starting with 449ae8fba2064fc8cd75a6d71ed8e268445f3f282ddb823810cfecd5596bf69a not found: ID does not exist" Jun 11 15:22:50.477388 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477344 2582 scope.go:117] "RemoveContainer" containerID="a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a" Jun 11 15:22:50.477585 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477561 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a"} err="failed to get container status \"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a\": rpc error: code = NotFound desc = could not find container \"a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a\": container with ID starting with a92b52a7bc391f062c0ec7d28ee2a3129f2ac1cc51007371e2154521811e077a not found: ID does not exist" Jun 11 15:22:50.477585 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477584 2582 scope.go:117] "RemoveContainer" containerID="797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577" Jun 11 15:22:50.477813 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.477796 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577"} err="failed to get container status \"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577\": rpc error: code = NotFound desc = could not find container \"797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577\": container with ID starting with 797a13ba8ddd667d62fa5635337a1912411caa799f9e0a12a3a0c6d4ae5fd577 not found: ID does not exist" Jun 11 15:22:50.480234 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.480204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.482665 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.482645 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:22:50.482782 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.482692 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:22:50.482782 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.482696 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:22:50.482947 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.482927 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:22:50.483003 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.482958 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s2hpl\"" Jun 11 15:22:50.483049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.483021 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:22:50.483049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.483023 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:22:50.483049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.483042 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:22:50.483301 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.483284 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:22:50.488566 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.488547 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:22:50.493743 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.493724 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:50.623486 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623668 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-web-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623668 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623585 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623668 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623668 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623668 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623664 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-out\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623847 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxkz\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-kube-api-access-djxkz\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.623952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.624176 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.623996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-web-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725512 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-out\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxkz\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-kube-api-access-djxkz\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.725930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.725775 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.728292 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.726866 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.728727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.728695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-web-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.728836 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.728723 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.728836 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.728774 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.728946 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.728839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.729009 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.728943 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.729357 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.729335 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.729531 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.729512 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.729581 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.729535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-config-out\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.729756 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.729739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.730828 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.730806 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.737071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.737051 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxkz\" (UniqueName: \"kubernetes.io/projected/a4a89b1b-a561-4ebd-9d61-7e8fc501349d-kube-api-access-djxkz\") pod \"alertmanager-main-0\" (UID: \"a4a89b1b-a561-4ebd-9d61-7e8fc501349d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.795240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.795184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:50.937945 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:50.937910 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:50.941311 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:22:50.941274 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a89b1b_a561_4ebd_9d61_7e8fc501349d.slice/crio-1f7d08659dbeb8dde0b9fdc5f022aac34be65f84c3cb921b4d71fdded831cd4c WatchSource:0}: Error finding container 1f7d08659dbeb8dde0b9fdc5f022aac34be65f84c3cb921b4d71fdded831cd4c: Status 404 returned error can't find the container with id 1f7d08659dbeb8dde0b9fdc5f022aac34be65f84c3cb921b4d71fdded831cd4c Jun 11 15:22:51.029199 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.029173 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:22:51.031712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.031688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b359b556-ed0c-45db-b6a9-0e23e66c8456-metrics-certs\") pod \"network-metrics-daemon-crdqt\" (UID: \"b359b556-ed0c-45db-b6a9-0e23e66c8456\") " pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:22:51.069549 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.069530 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptqhc\"" Jun 11 15:22:51.071777 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.071756 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94eabab4-2e64-4053-b1ed-e6e48ab08bcf" path="/var/lib/kubelet/pods/94eabab4-2e64-4053-b1ed-e6e48ab08bcf/volumes" Jun 11 15:22:51.077600 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.077583 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-crdqt" Jun 11 15:22:51.209164 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.209132 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-crdqt"] Jun 11 15:22:51.212564 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:22:51.212532 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb359b556_ed0c_45db_b6a9_0e23e66c8456.slice/crio-24b006a8d5a2e285da08da8f03b9b51483fd5bfcb18869076046362c9d722923 WatchSource:0}: Error finding container 24b006a8d5a2e285da08da8f03b9b51483fd5bfcb18869076046362c9d722923: Status 404 returned error can't find the container with id 24b006a8d5a2e285da08da8f03b9b51483fd5bfcb18869076046362c9d722923 Jun 11 15:22:51.214719 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.214703 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:22:51.424730 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.424697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-crdqt" event={"ID":"b359b556-ed0c-45db-b6a9-0e23e66c8456","Type":"ContainerStarted","Data":"24b006a8d5a2e285da08da8f03b9b51483fd5bfcb18869076046362c9d722923"} Jun 11 15:22:51.427104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.427080 2582 generic.go:356] "Generic (PLEG): container finished" podID="a4a89b1b-a561-4ebd-9d61-7e8fc501349d" containerID="159cbbd21987a2e2ec76870eb28fcbf7edfed7c1509cd5711917a6bbb84afb04" exitCode=0 Jun 11 15:22:51.427205 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.427121 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerDied","Data":"159cbbd21987a2e2ec76870eb28fcbf7edfed7c1509cd5711917a6bbb84afb04"} Jun 11 15:22:51.427205 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:51.427163 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"1f7d08659dbeb8dde0b9fdc5f022aac34be65f84c3cb921b4d71fdded831cd4c"} Jun 11 15:22:52.433508 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.433410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-crdqt" event={"ID":"b359b556-ed0c-45db-b6a9-0e23e66c8456","Type":"ContainerStarted","Data":"de6301ed797eea908a649623004e21579a31dd092ef929a923ddcf7c8526b449"} Jun 11 15:22:52.433935 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.433889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-crdqt" event={"ID":"b359b556-ed0c-45db-b6a9-0e23e66c8456","Type":"ContainerStarted","Data":"fe33881816e26fd9306ac44f39777e2f9c7f0d71aff126847ff60fac9160e1d3"} Jun 11 15:22:52.442865 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442838 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"4996dc57b65b9a249179e05357653888bb5652beb4a33ff3c0749c4a3384947a"} Jun 11 15:22:52.443008 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"bfb4924ca5ca4ba8d3ef53a5ad88bed7825cdab1e26433f41d43c5e6700e3b15"} Jun 11 15:22:52.443008 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"afcbce23d134d201361550798630b8da72445995fd24f108d6eb23d17f971fcb"} Jun 11 15:22:52.443008 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"849f58f8f9c821df9e32c7d83bc075f30fc46841515584fce1a5d967988f5e6d"} Jun 11 15:22:52.443008 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442960 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"add7028b0251887cf146eb6abc47ef2e6bd6397618433ca83b17a25bc97a23ea"} Jun 11 15:22:52.443008 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.442987 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a4a89b1b-a561-4ebd-9d61-7e8fc501349d","Type":"ContainerStarted","Data":"2aae2094596ae2d4909194597d3c7fc8027e46af90377b0ad1b8398d3f196731"} Jun 11 15:22:52.455485 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.455463 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d46958b75-7fhgb"] Jun 11 15:22:52.457773 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.457706 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-crdqt" podStartSLOduration=374.563580738 podStartE2EDuration="6m15.457688364s" totalImagesPullingTime="894.107626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:52.457038826 +0000 UTC m=+375.842236240" watchObservedRunningTime="2026-06-11 15:22:52.457688364 +0000 UTC m=+375.842885743" Jun 11 15:22:52.459099 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.459084 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.461626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.461604 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 15:22:52.461626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.461620 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 15:22:52.461811 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.461654 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 15:22:52.461811 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.461614 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-trt7f\"" Jun 11 15:22:52.461811 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.461605 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 15:22:52.462015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.462000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 15:22:52.467492 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.467411 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 15:22:52.473015 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.472995 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d46958b75-7fhgb"] Jun 11 15:22:52.487413 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.487369 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.472080562 podStartE2EDuration="2.487349127s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.268565ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:52.484342186 +0000 UTC m=+375.869539565" watchObservedRunningTime="2026-06-11 15:22:52.487349127 +0000 UTC m=+375.872546505" Jun 11 15:22:52.563891 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.563858 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:52.646712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-serving-certs-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-federate-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-metrics-client-ca\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.646933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ncp\" (UniqueName: \"kubernetes.io/projected/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-kube-api-access-x7ncp\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.647087 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.646957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.663586 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.663554 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:52.747703 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.747852 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-federate-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.747852 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-metrics-client-ca\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.747852 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.747852 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ncp\" (UniqueName: \"kubernetes.io/projected/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-kube-api-access-x7ncp\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.747852 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.748095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.748095 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.747937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-serving-certs-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.748522 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.748490 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-metrics-client-ca\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.748716 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.748690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-serving-certs-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.748845 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.748690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.751059 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.751038 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-telemeter-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.751178 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.751158 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.751245 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.751170 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-secret-telemeter-client\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.751284 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.751254 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-federate-client-tls\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.758111 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758089 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:52.758418 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758391 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="prometheus" containerID="cri-o://d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" gracePeriod=600 Jun 11 15:22:52.758498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758424 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy" containerID="cri-o://bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" gracePeriod=600 Jun 11 15:22:52.758498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758424 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="config-reloader" containerID="cri-o://24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" gracePeriod=600 Jun 11 15:22:52.758498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758420 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="thanos-sidecar" containerID="cri-o://e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" gracePeriod=600 Jun 11 15:22:52.758498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758404 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-web" containerID="cri-o://449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" gracePeriod=600 Jun 11 15:22:52.758704 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.758538 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" gracePeriod=600 Jun 11 15:22:52.762476 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.762428 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ncp\" (UniqueName: \"kubernetes.io/projected/0d59798a-fd00-4b78-8f78-a8adcc2fdbc0-kube-api-access-x7ncp\") pod \"telemeter-client-7d46958b75-7fhgb\" (UID: \"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0\") " pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.769993 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.769972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" Jun 11 15:22:52.914917 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:52.914887 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d46958b75-7fhgb"] Jun 11 15:22:52.916696 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:22:52.916661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d59798a_fd00_4b78_8f78_a8adcc2fdbc0.slice/crio-4bd58a0a24d6be241460aaaabeec574eb1d891844d5bfc5e9ea75e7b3fa69fab WatchSource:0}: Error finding container 4bd58a0a24d6be241460aaaabeec574eb1d891844d5bfc5e9ea75e7b3fa69fab: Status 404 returned error can't find the container with id 4bd58a0a24d6be241460aaaabeec574eb1d891844d5bfc5e9ea75e7b3fa69fab Jun 11 15:22:53.013456 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.013433 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.151596 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151550 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151596 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151602 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151627 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151651 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151672 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151689 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151711 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151727 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151754 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151783 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.151830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151814 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151844 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151890 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151924 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151956 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151992 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.151999 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152024 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152056 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152085 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc6w4\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152086 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.152289 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152110 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2\") pod \"c857b87b-833c-4c21-a498-fdd2fb2ca962\" (UID: \"c857b87b-833c-4c21-a498-fdd2fb2ca962\") " Jun 11 15:22:53.152825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152449 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.152825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152462 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.152825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152484 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.153144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.152988 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.154413 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.154211 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.154616 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.154593 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.155320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.155291 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:53.155504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.155429 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.155778 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.155740 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.155778 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.155746 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out" (OuterVolumeSpecName: "config-out") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:22:53.155924 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.155839 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.156089 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.156053 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:22:53.156568 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.156538 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.157041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.157017 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.157199 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.157177 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:53.157372 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.157322 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.157625 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.157599 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config" (OuterVolumeSpecName: "config") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.157887 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.157868 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4" (OuterVolumeSpecName: "kube-api-access-cc6w4") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "kube-api-access-cc6w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:53.158183 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.158169 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.167114 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.167093 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config" (OuterVolumeSpecName: "web-config") pod "c857b87b-833c-4c21-a498-fdd2fb2ca962" (UID: "c857b87b-833c-4c21-a498-fdd2fb2ca962"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253113 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-tls-assets\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253147 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253162 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253177 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-metrics-client-certs\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253189 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253204 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253201 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253214 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc6w4\" (UniqueName: \"kubernetes.io/projected/c857b87b-833c-4c21-a498-fdd2fb2ca962-kube-api-access-cc6w4\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253246 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253257 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-config-out\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253267 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-config\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253279 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-web-config\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253289 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-kube-rbac-proxy\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253302 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253314 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-configmap-metrics-client-ca\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253327 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253340 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-grpc-tls\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253354 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c857b87b-833c-4c21-a498-fdd2fb2ca962-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.253554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.253367 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c857b87b-833c-4c21-a498-fdd2fb2ca962-prometheus-k8s-db\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:22:53.452564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452524 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" exitCode=0 Jun 11 15:22:53.452564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452554 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" exitCode=0 Jun 11 15:22:53.452564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452565 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" exitCode=0 Jun 11 15:22:53.452564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452576 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" exitCode=0 Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452585 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" exitCode=0 Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452594 2582 generic.go:356] "Generic (PLEG): container finished" podID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" exitCode=0 Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452611 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452636 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452739 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452808 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452825 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} Jun 11 15:22:53.453271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.452909 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c857b87b-833c-4c21-a498-fdd2fb2ca962","Type":"ContainerDied","Data":"8f5dac1e954e8f9bb096adbddaee63d168a4b88397e5322d4be068b9de8fdae2"} Jun 11 15:22:53.454165 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.454131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" event={"ID":"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0","Type":"ContainerStarted","Data":"4bd58a0a24d6be241460aaaabeec574eb1d891844d5bfc5e9ea75e7b3fa69fab"} Jun 11 15:22:53.463907 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.463884 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.472208 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.472191 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.481749 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.481718 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:53.489787 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.489721 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:53.503736 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.503713 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.513309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.513289 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.518514 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.518489 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:53.518950 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.518929 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy" Jun 11 15:22:53.518950 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.518951 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.518968 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="config-reloader" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.518977 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="config-reloader" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519006 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="prometheus" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519016 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="prometheus" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519027 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="thanos-sidecar" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519036 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="thanos-sidecar" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519053 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="init-config-reloader" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519061 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="init-config-reloader" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519071 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-web" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519079 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-web" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519089 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-thanos" Jun 11 15:22:53.519108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519098 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-thanos" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519165 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="prometheus" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519178 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="config-reloader" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519190 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-thanos" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519201 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519210 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="thanos-sidecar" Jun 11 15:22:53.519618 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.519219 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" containerName="kube-rbac-proxy-web" Jun 11 15:22:53.521989 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.521968 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.525063 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.525041 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.528103 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.528079 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:22:53.528557 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.528492 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:22:53.529071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529014 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:22:53.529306 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529289 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:22:53.529436 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529417 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:22:53.529504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529488 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:22:53.529801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529782 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:22:53.529801 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529794 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:22:53.529931 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529810 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:22:53.530187 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.529989 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fod7cpeit10u4\"" Jun 11 15:22:53.530187 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.530068 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:22:53.530481 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.530434 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:22:53.530613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.530499 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:22:53.530674 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.530623 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:22:53.530674 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.530669 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c9mjw\"" Jun 11 15:22:53.535167 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.534846 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.539306 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.536802 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:22:53.539422 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.539401 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:22:53.545398 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.545375 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:53.549564 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.549544 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.549882 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.549853 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.549960 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.549893 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.549960 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.549918 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.550214 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.550193 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.550331 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550257 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.550331 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550274 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.550630 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.550613 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.550701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550632 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.550701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550647 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.550906 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.550877 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.550968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550908 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.550968 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.550932 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.551198 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.551180 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.551294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.551201 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.551294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.551214 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.551564 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.551537 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.551630 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.551568 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.551630 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.551583 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.551982 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:22:53.551963 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.552066 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.551988 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.552066 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552003 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.552306 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552249 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.552306 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552272 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.552538 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552511 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.552538 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552534 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.552789 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552766 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.552884 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.552789 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.553042 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553018 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.553100 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553045 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.553341 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553315 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.553341 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553340 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.553584 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553564 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.553667 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553587 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.553846 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553828 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.553929 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.553847 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.554119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554101 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.554179 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554119 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.554357 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554337 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.554430 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554360 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.554591 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554570 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.554591 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554589 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.554839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554821 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.554839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.554839 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.555161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.555140 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.555161 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.555161 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.555519 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.555485 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.555594 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.555522 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.556255 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556214 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.556346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556255 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.556498 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556478 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.556548 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556500 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.556706 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556687 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.556780 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556708 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.556957 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556929 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.557046 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.556971 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.557278 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557256 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.557363 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557280 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.557510 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557487 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.557510 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557508 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.557751 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557726 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.557810 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557754 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.558013 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.557996 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.558063 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558013 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.558186 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558171 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.558241 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558186 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.558356 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558339 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.558402 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558358 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.558596 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558580 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.558637 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558596 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.558784 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558765 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.558848 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.558786 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.559022 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559004 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.559067 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559024 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.559240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559207 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.559303 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559244 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.559466 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559449 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.559514 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559466 2582 scope.go:117] "RemoveContainer" containerID="3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce" Jun 11 15:22:53.559685 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559667 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce"} err="failed to get container status \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": rpc error: code = NotFound desc = could not find container \"3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce\": container with ID starting with 3bd8d79bf7705d992ed6ed133996124c2765334047cb3f2a1b92d3daccd4b9ce not found: ID does not exist" Jun 11 15:22:53.559746 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559687 2582 scope.go:117] "RemoveContainer" containerID="bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee" Jun 11 15:22:53.559904 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559885 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee"} err="failed to get container status \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": rpc error: code = NotFound desc = could not find container \"bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee\": container with ID starting with bff465340bcbb1ad32483497f7654546ff714493b7bd6e5444bb4334c2f319ee not found: ID does not exist" Jun 11 15:22:53.559904 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.559902 2582 scope.go:117] "RemoveContainer" containerID="449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f" Jun 11 15:22:53.560094 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560079 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f"} err="failed to get container status \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": rpc error: code = NotFound desc = could not find container \"449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f\": container with ID starting with 449bef08a660c0d2a9423460cd1ca88c2756c4f01b24217fb5d98e82207b759f not found: ID does not exist" Jun 11 15:22:53.560142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560094 2582 scope.go:117] "RemoveContainer" containerID="e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace" Jun 11 15:22:53.560317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560301 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace"} err="failed to get container status \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": rpc error: code = NotFound desc = could not find container \"e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace\": container with ID starting with e70c3744a26d8091802cded335c65ee4e93467787b82bd5175bcc0657f611ace not found: ID does not exist" Jun 11 15:22:53.560367 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560317 2582 scope.go:117] "RemoveContainer" containerID="24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1" Jun 11 15:22:53.560489 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560471 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1"} err="failed to get container status \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": rpc error: code = NotFound desc = could not find container \"24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1\": container with ID starting with 24a94adb471621ad80df544e560329c51aa0eebc5cdcb8767d86d92e09e46aa1 not found: ID does not exist" Jun 11 15:22:53.560489 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560487 2582 scope.go:117] "RemoveContainer" containerID="d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e" Jun 11 15:22:53.560650 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560633 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e"} err="failed to get container status \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": rpc error: code = NotFound desc = could not find container \"d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e\": container with ID starting with d58e825a83f7b2c36567181eb5d6810139e171c62fc406dc69878e183923509e not found: ID does not exist" Jun 11 15:22:53.560701 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560650 2582 scope.go:117] "RemoveContainer" containerID="c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2" Jun 11 15:22:53.560821 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.560806 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2"} err="failed to get container status \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": rpc error: code = NotFound desc = could not find container \"c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2\": container with ID starting with c7e3f2db2491920ec0a34ffe95e13f5ea80beecddbe43a803a527e9564fe51d2 not found: ID does not exist" Jun 11 15:22:53.656260 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656428 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656627 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656675 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.656894 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcl69\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-kube-api-access-hcl69\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.657202 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.656908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757688 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757688 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757688 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.757987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.757990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758125 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcl69\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-kube-api-access-hcl69\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758537 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.758926 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758763 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.759365 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.759338 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.760928 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.760900 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.761196 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.761092 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.761196 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.758356 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.761384 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.761261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.761384 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.761302 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.762185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.761872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.762185 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.761914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.762362 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.762308 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.762502 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.762441 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.762918 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.762888 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.763018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.762893 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.763649 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.763626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.764119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.764097 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.764320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.764303 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.764470 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.764453 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.767465 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.767447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcl69\" (UniqueName: \"kubernetes.io/projected/4a7117c2-7ec1-427f-91d7-4d1bb26f1a64-kube-api-access-hcl69\") pod \"prometheus-k8s-0\" (UID: \"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:53.838847 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:53.838808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:54.010552 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:54.010526 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:54.012220 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:22:54.012194 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7117c2_7ec1_427f_91d7_4d1bb26f1a64.slice/crio-2cb37159c2d07112ff6729d4d17fdbca505ae6aa5be7f5341afd5cdb91bd2e4f WatchSource:0}: Error finding container 2cb37159c2d07112ff6729d4d17fdbca505ae6aa5be7f5341afd5cdb91bd2e4f: Status 404 returned error can't find the container with id 2cb37159c2d07112ff6729d4d17fdbca505ae6aa5be7f5341afd5cdb91bd2e4f Jun 11 15:22:54.463239 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:54.463101 2582 generic.go:356] "Generic (PLEG): container finished" podID="4a7117c2-7ec1-427f-91d7-4d1bb26f1a64" containerID="8b3924ce73a30631feeaf69097abf7a53fb09ec3e7a256f184eca4adb8437829" exitCode=0 Jun 11 15:22:54.463739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:54.463250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerDied","Data":"8b3924ce73a30631feeaf69097abf7a53fb09ec3e7a256f184eca4adb8437829"} Jun 11 15:22:54.463739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:54.463326 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"2cb37159c2d07112ff6729d4d17fdbca505ae6aa5be7f5341afd5cdb91bd2e4f"} Jun 11 15:22:55.072416 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.072390 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c857b87b-833c-4c21-a498-fdd2fb2ca962" path="/var/lib/kubelet/pods/c857b87b-833c-4c21-a498-fdd2fb2ca962/volumes" Jun 11 15:22:55.475513 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"f246714f0044b3e265d3ffcd7db3a5d4f03418d444a44e9d8d7d8f1a10f02277"} Jun 11 15:22:55.475942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"e3b7291713d1ad8ef68918f76a0b5cef10640ef0203dd050393b8d42b6c5c1e1"} Jun 11 15:22:55.475942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475635 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"7847458942dcf1b00044fcbb04f3e2d034d479a419f4ddb62c0afe9274011386"} Jun 11 15:22:55.475942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475674 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"39f06a287c3cc0ed8c119a432104722d49e3063eee4d1a99aa9e0aa20f2c1893"} Jun 11 15:22:55.475942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475711 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"8a0fa3e3b3e0d87d7df2169e11c76e5d22d15dbca6dcc4ac3fe6e155011b7dd5"} Jun 11 15:22:55.475942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.475740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7117c2-7ec1-427f-91d7-4d1bb26f1a64","Type":"ContainerStarted","Data":"788cbbe60e1caefb3fb54d7438327be6026d49bd1e3c889a730d64591bc4d0f2"} Jun 11 15:22:55.477935 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.477909 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" event={"ID":"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0","Type":"ContainerStarted","Data":"13e67c5803e07b96ba7765b0ae3f32a7e73e097dbbb325ecae4cb12efb73f507"} Jun 11 15:22:55.478080 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.477967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" event={"ID":"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0","Type":"ContainerStarted","Data":"1d5179542a1971bc8afb00c63df6c5bc787e6e70fed769dccd06fa211a22c233"} Jun 11 15:22:55.478080 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.477995 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" event={"ID":"0d59798a-fd00-4b78-8f78-a8adcc2fdbc0","Type":"ContainerStarted","Data":"04533ddba424e17c4e662454a00395bd1fe9ab08fa0ccc46969260b5c2303b13"} Jun 11 15:22:55.508989 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.508937 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.485901637 podStartE2EDuration="2.508920006s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.018369ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:55.507007712 +0000 UTC m=+378.892205089" watchObservedRunningTime="2026-06-11 15:22:55.508920006 +0000 UTC m=+378.894117385" Jun 11 15:22:55.532965 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:55.532916 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d46958b75-7fhgb" podStartSLOduration=1.680592131 podStartE2EDuration="3.532901803s" totalImagesPullingTime="1.852309672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:55.531060394 +0000 UTC m=+378.916257774" watchObservedRunningTime="2026-06-11 15:22:55.532901803 +0000 UTC m=+378.918099180" Jun 11 15:22:56.308509 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:56.308471 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:56.449131 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:56.449093 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:56.549790 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:56.549749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:57.133688 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:57.133652 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:57.207919 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:57.207877 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:22:58.839863 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:22:58.839825 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:04.378481 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:04.378435 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:23:04.445389 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:04.445348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:23:07.436387 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:07.436351 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:23:07.504821 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:07.504772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:23:07.573090 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:07.573049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:23:53.839598 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:53.839567 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:53.856380 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:53.856354 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:54.746081 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:23:54.746000 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:24:02.630827 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:02.630788 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:02.732164 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:02.732126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:05.261141 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:05.261100 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:05.332278 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:05.332217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:14.538828 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:14.538774 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:14.610702 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:14.610665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:15.704196 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:15.704159 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:15.804464 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:15.804427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:15.875426 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:15.875394 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:29.858188 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:29.858149 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:24:29.958076 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:24:29.958040 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:25:23.658171 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:25:23.658125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:25:35.261723 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:25:35.261640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:25:35.362310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:25:35.362272 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:25:41.271769 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:25:41.271725 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:01.987811 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:01.987762 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:03.063383 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:03.063319 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:05.609288 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:05.609242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:05.709654 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:05.709616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:06.984769 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:06.984730 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:07.090690 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:07.090651 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:07.330218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:07.330178 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:07.435046 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:07.435010 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:10.299888 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:10.299847 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:10.883908 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:10.883876 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:12.204365 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:12.204331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:12.305348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:12.305316 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:15.789314 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:15.789276 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:15.849600 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:15.849564 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:18.610241 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:18.610194 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:18.721750 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:18.721709 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:18.812875 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:18.812846 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:24.712664 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:24.712627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:24.805343 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:24.805309 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:26.608556 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:26.608520 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:32.847163 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:32.847126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:37.066166 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:37.066135 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:26:37.068385 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:37.068365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:26:39.040608 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:39.040564 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:39.133665 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:39.133541 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:39.677613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:39.677580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:39.911583 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:39.911539 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.017250 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.017194 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.053131 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.053098 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm"] Jun 11 15:26:40.055458 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.055441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.058455 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.058426 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:26:40.058626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.058478 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q7r6r\"" Jun 11 15:26:40.058626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.058489 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:26:40.058626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.058427 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:26:40.060201 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.060186 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:26:40.078606 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.078576 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm"] Jun 11 15:26:40.144103 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.144066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-tmp\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.144304 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.144117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.144304 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.144163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl85h\" (UniqueName: \"kubernetes.io/projected/0da60e2d-feb3-4ac1-843d-732137bc980f-kube-api-access-jl85h\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.144304 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.144186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-manifests\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.144304 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.144244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.165876 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.165842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.245582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.245552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.245752 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.245624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-tmp\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.245752 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.245675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.245752 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.245728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl85h\" (UniqueName: \"kubernetes.io/projected/0da60e2d-feb3-4ac1-843d-732137bc980f-kube-api-access-jl85h\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.245934 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.245761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-manifests\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.246240 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.246193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-manifests\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.248090 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.248059 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0da60e2d-feb3-4ac1-843d-732137bc980f-tmp\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.248188 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.248158 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.248278 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.248184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0da60e2d-feb3-4ac1-843d-732137bc980f-webhook-cert\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.260667 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.260639 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl85h\" (UniqueName: \"kubernetes.io/projected/0da60e2d-feb3-4ac1-843d-732137bc980f-kube-api-access-jl85h\") pod \"opendatahub-operator-controller-manager-75d47b57f5-l8fsm\" (UID: \"0da60e2d-feb3-4ac1-843d-732137bc980f\") " pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.277579 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.277498 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.366348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.366303 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:40.371929 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.371891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.467689 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.467653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.512257 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.512136 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm"] Jun 11 15:26:40.514642 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:26:40.514622 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da60e2d_feb3_4ac1_843d_732137bc980f.slice/crio-7306652a573b8babd75a8b340629cfddd1773e144e41b2ec7d7e22366f205667 WatchSource:0}: Error finding container 7306652a573b8babd75a8b340629cfddd1773e144e41b2ec7d7e22366f205667: Status 404 returned error can't find the container with id 7306652a573b8babd75a8b340629cfddd1773e144e41b2ec7d7e22366f205667 Jun 11 15:26:40.568497 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.568407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.683218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.683179 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:40.767542 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:40.767509 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:41.414823 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:41.414781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" event={"ID":"0da60e2d-feb3-4ac1-843d-732137bc980f","Type":"ContainerStarted","Data":"7306652a573b8babd75a8b340629cfddd1773e144e41b2ec7d7e22366f205667"} Jun 11 15:26:41.699436 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:41.699335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:41.799975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:41.799938 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:43.426355 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:43.426318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" event={"ID":"0da60e2d-feb3-4ac1-843d-732137bc980f","Type":"ContainerStarted","Data":"00308f7831d9494242ddaf0241030b384bc42c9b4d16073437084f406c62b317"} Jun 11 15:26:43.733453 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:43.733417 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:43.833722 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:43.833685 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:44.439245 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:44.439191 2582 generic.go:356] "Generic (PLEG): container finished" podID="0da60e2d-feb3-4ac1-843d-732137bc980f" containerID="00308f7831d9494242ddaf0241030b384bc42c9b4d16073437084f406c62b317" exitCode=0 Jun 11 15:26:44.439621 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:44.439278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" event={"ID":"0da60e2d-feb3-4ac1-843d-732137bc980f","Type":"ContainerDied","Data":"00308f7831d9494242ddaf0241030b384bc42c9b4d16073437084f406c62b317"} Jun 11 15:26:45.446427 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:45.446388 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" event={"ID":"0da60e2d-feb3-4ac1-843d-732137bc980f","Type":"ContainerStarted","Data":"7441d902dbf5bf69e3729fd9444de969014b1ad4104357be43fdcf4a6ca8ec91"} Jun 11 15:26:45.446847 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:45.446499 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:45.471139 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:45.471088 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" podStartSLOduration=1.402771872 podStartE2EDuration="5.471072538s" totalImagesPullingTime="3.160413808s" totalInitContainerRuntime="907.886858ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:45.470031735 +0000 UTC m=+608.855229149" watchObservedRunningTime="2026-06-11 15:26:45.471072538 +0000 UTC m=+608.856269916" Jun 11 15:26:50.588379 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:50.588341 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:50.670089 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:50.670054 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:50.865464 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:50.865384 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:50.976927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:50.976883 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:56.453860 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:56.453821 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75d47b57f5-l8fsm" Jun 11 15:26:58.682938 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:58.682905 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:58.794517 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:58.794465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.031655 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.031623 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.124069 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.124031 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.428036 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.427947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.436837 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.436809 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq"] Jun 11 15:26:59.442932 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.442911 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.446635 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446599 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:26:59.446635 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446600 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:26:59.446859 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446632 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:26:59.446859 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446706 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:26:59.446859 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446834 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v7lbk\"" Jun 11 15:26:59.447007 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.446942 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:26:59.451528 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.451506 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq"] Jun 11 15:26:59.514691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.514655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-metrics-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.514878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.514719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqwv\" (UniqueName: \"kubernetes.io/projected/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-kube-api-access-clqwv\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.514878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.514752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.514878 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.514791 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-manager-config\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.585172 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.585126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.615390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.615351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-metrics-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.615609 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.615404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clqwv\" (UniqueName: \"kubernetes.io/projected/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-kube-api-access-clqwv\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.615609 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.615428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.615609 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.615468 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-manager-config\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.616337 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.616245 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-manager-config\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.618366 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.618338 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-metrics-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.618643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.618619 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-cert\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.626051 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.626020 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqwv\" (UniqueName: \"kubernetes.io/projected/fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2-kube-api-access-clqwv\") pod \"lws-controller-manager-779bc94b4d-jnhqq\" (UID: \"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2\") " pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.688825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.688737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.753490 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.753462 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:26:59.771369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.771335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:26:59.905630 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:26:59.905597 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq"] Jun 11 15:26:59.909062 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:26:59.909032 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdf16fe_c7c2_4cd2_be27_89d7abad2ed2.slice/crio-6e9d332fee8373e5e4a8f8f50902436b62d9f318e603a4fd24427fde0ee39070 WatchSource:0}: Error finding container 6e9d332fee8373e5e4a8f8f50902436b62d9f318e603a4fd24427fde0ee39070: Status 404 returned error can't find the container with id 6e9d332fee8373e5e4a8f8f50902436b62d9f318e603a4fd24427fde0ee39070 Jun 11 15:27:00.340756 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:00.340721 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:00.515184 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:00.515141 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" event={"ID":"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2","Type":"ContainerStarted","Data":"6e9d332fee8373e5e4a8f8f50902436b62d9f318e603a4fd24427fde0ee39070"} Jun 11 15:27:01.294546 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:01.294504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:02.527511 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:02.527478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" event={"ID":"fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2","Type":"ContainerStarted","Data":"2489f2d6df545d8ea998152b36354c3967f62045e738d5d557d61ff718666365"} Jun 11 15:27:02.527963 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:02.527557 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:27:02.549700 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:02.549647 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" podStartSLOduration=1.038693863 podStartE2EDuration="3.549631072s" totalImagesPullingTime="2.510937209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:02.546574268 +0000 UTC m=+625.931771670" watchObservedRunningTime="2026-06-11 15:27:02.549631072 +0000 UTC m=+625.934828449" Jun 11 15:27:09.688292 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:09.688244 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:09.828671 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:09.828634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:09.914048 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:09.914013 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:09.985155 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:09.985055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:10.998274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:10.998238 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:11.099727 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:11.099687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:11.203293 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:11.203216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:13.534526 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:13.534495 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-779bc94b4d-jnhqq" Jun 11 15:27:15.776455 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:15.776410 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:15.885713 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:15.885678 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:17.270857 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:17.270823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:17.484276 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:17.484210 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:17.710488 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:17.710398 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:18.086613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:18.086576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:28.057491 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:28.057439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:28.157918 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:28.157884 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:28.331902 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:28.331806 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:28.430807 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:28.430770 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:28.797457 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:28.797425 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.386243 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.386189 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.486831 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.486778 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.673467 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.673393 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626"] Jun 11 15:27:31.680338 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.680315 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.683198 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.683177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:27:31.683337 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.683194 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d6kbg\"" Jun 11 15:27:31.683337 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.683177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 15:27:31.683337 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.683254 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:27:31.691726 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.691705 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626"] Jun 11 15:27:31.694770 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.694744 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.727530 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727530 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf15958-e508-447e-85f7-b06ceda891d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sskth\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-kube-api-access-sskth\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727731 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727928 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf15958-e508-447e-85f7-b06ceda891d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727928 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.727928 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.727811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829014 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf15958-e508-447e-85f7-b06ceda891d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829056 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf15958-e508-447e-85f7-b06ceda891d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829540 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sskth\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-kube-api-access-sskth\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829540 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829540 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829502 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829540 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829519 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.829734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.829542 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.830174 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.830151 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.830320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.830153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.830320 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.830262 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf15958-e508-447e-85f7-b06ceda891d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.831942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.831912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf15958-e508-447e-85f7-b06ceda891d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.832065 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.831977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf15958-e508-447e-85f7-b06ceda891d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.833589 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.833560 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.840386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.840362 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sskth\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-kube-api-access-sskth\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.842438 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.842419 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf15958-e508-447e-85f7-b06ceda891d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979559626\" (UID: \"1bf15958-e508-447e-85f7-b06ceda891d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:31.948902 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.948808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:31.992800 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:31.992772 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:32.137038 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:32.137015 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626"] Jun 11 15:27:32.140155 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:27:32.140132 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf15958_e508_447e_85f7_b06ceda891d5.slice/crio-4214229110cc50bf3def87dcc7511db117126ab5f8fd05e0acd7d9471cb083a5 WatchSource:0}: Error finding container 4214229110cc50bf3def87dcc7511db117126ab5f8fd05e0acd7d9471cb083a5: Status 404 returned error can't find the container with id 4214229110cc50bf3def87dcc7511db117126ab5f8fd05e0acd7d9471cb083a5 Jun 11 15:27:32.676487 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:32.676443 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" event={"ID":"1bf15958-e508-447e-85f7-b06ceda891d5","Type":"ContainerStarted","Data":"4214229110cc50bf3def87dcc7511db117126ab5f8fd05e0acd7d9471cb083a5"} Jun 11 15:27:34.919370 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:34.919329 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:27:34.919616 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:34.919405 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:27:34.919616 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:34.919436 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:27:35.694690 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:35.694647 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" event={"ID":"1bf15958-e508-447e-85f7-b06ceda891d5","Type":"ContainerStarted","Data":"8cab0d9b8162181b72f229c999000f867127ca136bb57cf9c808fe1e2fc19155"} Jun 11 15:27:35.717871 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:35.717809 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" podStartSLOduration=1.9408057269999999 podStartE2EDuration="4.71779359s" totalImagesPullingTime="2.776987863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:35.716067643 +0000 UTC m=+659.101265022" watchObservedRunningTime="2026-06-11 15:27:35.71779359 +0000 UTC m=+659.102990967" Jun 11 15:27:35.992961 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:35.992883 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:36.104644 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.104611 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm"] Jun 11 15:27:36.111355 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.111330 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.113814 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.113787 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 15:27:36.113814 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.113805 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2596j\"" Jun 11 15:27:36.120826 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.120787 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm"] Jun 11 15:27:36.137963 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.137931 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:27:36.159655 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.159616 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:36.176807 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.176778 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkbp\" (UniqueName: \"kubernetes.io/projected/a58ac116-faa2-4962-9bea-a5faf2f7a656-kube-api-access-drkbp\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.176971 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.176819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a58ac116-faa2-4962-9bea-a5faf2f7a656-redirect-config\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.278317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.278285 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkbp\" (UniqueName: \"kubernetes.io/projected/a58ac116-faa2-4962-9bea-a5faf2f7a656-kube-api-access-drkbp\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.278486 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.278332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a58ac116-faa2-4962-9bea-a5faf2f7a656-redirect-config\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.279003 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.278985 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a58ac116-faa2-4962-9bea-a5faf2f7a656-redirect-config\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.287263 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.287212 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkbp\" (UniqueName: \"kubernetes.io/projected/a58ac116-faa2-4962-9bea-a5faf2f7a656-kube-api-access-drkbp\") pod \"dashboard-redirect-5c5fc9dbd9-t64nm\" (UID: \"a58ac116-faa2-4962-9bea-a5faf2f7a656\") " pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.424321 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.424288 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" Jun 11 15:27:36.557966 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.557941 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm"] Jun 11 15:27:36.560366 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:27:36.560335 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58ac116_faa2_4962_9bea_a5faf2f7a656.slice/crio-2e082f1f13a4e3014c6ce76c7c1836329ff0efa4f6a896ae420272e3312c73cd WatchSource:0}: Error finding container 2e082f1f13a4e3014c6ce76c7c1836329ff0efa4f6a896ae420272e3312c73cd: Status 404 returned error can't find the container with id 2e082f1f13a4e3014c6ce76c7c1836329ff0efa4f6a896ae420272e3312c73cd Jun 11 15:27:36.700746 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.700709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" event={"ID":"a58ac116-faa2-4962-9bea-a5faf2f7a656","Type":"ContainerStarted","Data":"2e082f1f13a4e3014c6ce76c7c1836329ff0efa4f6a896ae420272e3312c73cd"} Jun 11 15:27:36.700937 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.700920 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:36.701875 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:36.701857 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979559626" Jun 11 15:27:44.742856 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:44.742814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" event={"ID":"a58ac116-faa2-4962-9bea-a5faf2f7a656","Type":"ContainerStarted","Data":"4665220c4e66d431b64569199d141b56b3eb2e2d697f66f39b350748cf5d0216"} Jun 11 15:27:44.759825 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:27:44.759766 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c5fc9dbd9-t64nm" podStartSLOduration=1.6511332300000001 podStartE2EDuration="8.759745669s" totalImagesPullingTime="7.108612439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:44.759161342 +0000 UTC m=+668.144358720" watchObservedRunningTime="2026-06-11 15:27:44.759745669 +0000 UTC m=+668.144943049" Jun 11 15:28:00.371684 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.371645 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:00.464388 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.464352 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:00.488553 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.488521 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:00.491976 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.491951 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:00.494880 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.494855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-64cfd\"" Jun 11 15:28:00.494880 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.494872 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:28:00.495077 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.495021 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:28:00.506139 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.506115 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:00.536768 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.536714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:00.602249 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.602195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzxd\" (UniqueName: \"kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd\") pod \"kuadrant-operator-catalog-n7mxp\" (UID: \"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883\") " pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:00.703762 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.703670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzxd\" (UniqueName: \"kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd\") pod \"kuadrant-operator-catalog-n7mxp\" (UID: \"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883\") " pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:00.712499 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.712470 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzxd\" (UniqueName: \"kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd\") pod \"kuadrant-operator-catalog-n7mxp\" (UID: \"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883\") " pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:00.802238 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.802197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:00.851614 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.851584 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:00.939656 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.939628 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:00.941828 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:00.941799 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc91e3b_813e_4ec3_b7fc_ae1eafc47883.slice/crio-df3acece773f9857f513cac4cdc499e9ec58f48a2287160028be7271b41f39c7 WatchSource:0}: Error finding container df3acece773f9857f513cac4cdc499e9ec58f48a2287160028be7271b41f39c7: Status 404 returned error can't find the container with id df3acece773f9857f513cac4cdc499e9ec58f48a2287160028be7271b41f39c7 Jun 11 15:28:00.943241 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:00.943211 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:28:01.061473 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.061439 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5f69w"] Jun 11 15:28:01.066109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.066090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:01.074547 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.074522 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5f69w"] Jun 11 15:28:01.209351 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.209316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzqp\" (UniqueName: \"kubernetes.io/projected/b7acb485-14e4-4342-9fd4-289df4981865-kube-api-access-pdzqp\") pod \"kuadrant-operator-catalog-5f69w\" (UID: \"b7acb485-14e4-4342-9fd4-289df4981865\") " pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:01.290653 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.290619 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:01.310721 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.310692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzqp\" (UniqueName: \"kubernetes.io/projected/b7acb485-14e4-4342-9fd4-289df4981865-kube-api-access-pdzqp\") pod \"kuadrant-operator-catalog-5f69w\" (UID: \"b7acb485-14e4-4342-9fd4-289df4981865\") " pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:01.320571 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.320516 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzqp\" (UniqueName: \"kubernetes.io/projected/b7acb485-14e4-4342-9fd4-289df4981865-kube-api-access-pdzqp\") pod \"kuadrant-operator-catalog-5f69w\" (UID: \"b7acb485-14e4-4342-9fd4-289df4981865\") " pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:01.377202 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.377168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:01.493886 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.493797 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:01.525460 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.525418 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5f69w"] Jun 11 15:28:01.530378 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:01.530349 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7acb485_14e4_4342_9fd4_289df4981865.slice/crio-240e2b0c9437631b6bbf5c2d46a0a63d572e932e2575183bada5eaa4f8e4d89e WatchSource:0}: Error finding container 240e2b0c9437631b6bbf5c2d46a0a63d572e932e2575183bada5eaa4f8e4d89e: Status 404 returned error can't find the container with id 240e2b0c9437631b6bbf5c2d46a0a63d572e932e2575183bada5eaa4f8e4d89e Jun 11 15:28:01.828472 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.828432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" event={"ID":"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883","Type":"ContainerStarted","Data":"df3acece773f9857f513cac4cdc499e9ec58f48a2287160028be7271b41f39c7"} Jun 11 15:28:01.829626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:01.829590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" event={"ID":"b7acb485-14e4-4342-9fd4-289df4981865","Type":"ContainerStarted","Data":"240e2b0c9437631b6bbf5c2d46a0a63d572e932e2575183bada5eaa4f8e4d89e"} Jun 11 15:28:02.109973 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:02.109881 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:03.842308 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:03.842265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" event={"ID":"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883","Type":"ContainerStarted","Data":"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d"} Jun 11 15:28:03.842778 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:03.842354 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" podUID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" containerName="registry-server" containerID="cri-o://d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d" gracePeriod=2 Jun 11 15:28:03.844056 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:03.844032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" event={"ID":"b7acb485-14e4-4342-9fd4-289df4981865","Type":"ContainerStarted","Data":"37516e467a37b1c5415e3ecf39c87559beee4adea1292e4d0c4af8040c401a6f"} Jun 11 15:28:03.858186 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:03.858131 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" podStartSLOduration=1.516690759 podStartE2EDuration="3.858112437s" totalImagesPullingTime="2.341421678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:03.857852155 +0000 UTC m=+687.243049532" watchObservedRunningTime="2026-06-11 15:28:03.858112437 +0000 UTC m=+687.243309817" Jun 11 15:28:03.874265 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:03.874206 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" podStartSLOduration=1.118556408 podStartE2EDuration="2.87419251s" totalImagesPullingTime="1.755636102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:03.872775912 +0000 UTC m=+687.257973290" watchObservedRunningTime="2026-06-11 15:28:03.87419251 +0000 UTC m=+687.259389888" Jun 11 15:28:04.082542 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.082517 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:04.239597 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.239500 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldzxd\" (UniqueName: \"kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd\") pod \"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883\" (UID: \"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883\") " Jun 11 15:28:04.241889 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.241860 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd" (OuterVolumeSpecName: "kube-api-access-ldzxd") pod "6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" (UID: "6bc91e3b-813e-4ec3-b7fc-ae1eafc47883"). InnerVolumeSpecName "kube-api-access-ldzxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:28:04.340272 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.340241 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldzxd\" (UniqueName: \"kubernetes.io/projected/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883-kube-api-access-ldzxd\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:28:04.849442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.849411 2582 generic.go:356] "Generic (PLEG): container finished" podID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" containerID="d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d" exitCode=0 Jun 11 15:28:04.849921 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.849453 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" Jun 11 15:28:04.849921 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.849498 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" event={"ID":"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883","Type":"ContainerDied","Data":"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d"} Jun 11 15:28:04.849921 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.849560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7mxp" event={"ID":"6bc91e3b-813e-4ec3-b7fc-ae1eafc47883","Type":"ContainerDied","Data":"df3acece773f9857f513cac4cdc499e9ec58f48a2287160028be7271b41f39c7"} Jun 11 15:28:04.849921 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.849593 2582 scope.go:117] "RemoveContainer" containerID="d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d" Jun 11 15:28:04.859063 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.859046 2582 scope.go:117] "RemoveContainer" containerID="d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d" Jun 11 15:28:04.859336 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:04.859318 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d\": container with ID starting with d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d not found: ID does not exist" containerID="d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d" Jun 11 15:28:04.859381 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.859346 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d"} err="failed to get container status \"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d\": rpc error: code = NotFound desc = could not find container \"d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d\": container with ID starting with d0852a17fcac99eafa518ef41cd449c668a982000b491a1fe761f277ff65761d not found: ID does not exist" Jun 11 15:28:04.870429 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.870407 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:04.874333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:04.874311 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7mxp"] Jun 11 15:28:05.072389 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:05.072350 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" path="/var/lib/kubelet/pods/6bc91e3b-813e-4ec3-b7fc-ae1eafc47883/volumes" Jun 11 15:28:11.377975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:11.377935 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:11.378470 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:11.378001 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:11.400578 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:11.400552 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:11.903494 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:11.903466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5f69w" Jun 11 15:28:21.786494 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:21.786447 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:23.959309 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:23.959279 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:28.482412 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.482327 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq"] Jun 11 15:28:28.482778 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.482707 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" containerName="registry-server" Jun 11 15:28:28.482778 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.482718 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" containerName="registry-server" Jun 11 15:28:28.482851 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.482792 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc91e3b-813e-4ec3-b7fc-ae1eafc47883" containerName="registry-server" Jun 11 15:28:28.485595 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.485580 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.488183 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.488162 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9xn6m\"" Jun 11 15:28:28.503692 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.503664 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq"] Jun 11 15:28:28.572992 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.572954 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.573160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.573010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs85h\" (UniqueName: \"kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.674379 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.674320 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs85h\" (UniqueName: \"kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.674567 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.674443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.674802 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.674785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.683477 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.683451 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs85h\" (UniqueName: \"kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.796421 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.796387 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:28.937879 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.937854 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq"] Jun 11 15:28:28.940803 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:28.940771 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7934a91_9b3d_4de3_b71c_483bd026e5fe.slice/crio-939f26c616a7d0b2de55028a2d81d99aa90b83690189b7b9aeee1985c0c3984e WatchSource:0}: Error finding container 939f26c616a7d0b2de55028a2d81d99aa90b83690189b7b9aeee1985c0c3984e: Status 404 returned error can't find the container with id 939f26c616a7d0b2de55028a2d81d99aa90b83690189b7b9aeee1985c0c3984e Jun 11 15:28:28.958982 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:28.958954 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" event={"ID":"c7934a91-9b3d-4de3-b71c-483bd026e5fe","Type":"ContainerStarted","Data":"939f26c616a7d0b2de55028a2d81d99aa90b83690189b7b9aeee1985c0c3984e"} Jun 11 15:28:29.766361 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:29.766323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:31.930531 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:31.930467 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf"] Jun 11 15:28:31.933922 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:31.933899 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:31.938303 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:31.938281 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-48cwm\"" Jun 11 15:28:31.944036 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:31.944008 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf"] Jun 11 15:28:32.104683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.104637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffkqp\" (UniqueName: \"kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp\") pod \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" (UID: \"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:32.205857 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.205745 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffkqp\" (UniqueName: \"kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp\") pod \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" (UID: \"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:32.215504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.215468 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffkqp\" (UniqueName: \"kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp\") pod \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" (UID: \"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:32.245460 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.245427 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:32.404317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.404288 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf"] Jun 11 15:28:32.406161 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:32.406134 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05c0b5e_2b35_4fff_863a_aa0ee1b8c523.slice/crio-83c6112b8e1b198ce362ddcc75c4030be9fe689f35a2f8d264a7ca5cd60cdd1d WatchSource:0}: Error finding container 83c6112b8e1b198ce362ddcc75c4030be9fe689f35a2f8d264a7ca5cd60cdd1d: Status 404 returned error can't find the container with id 83c6112b8e1b198ce362ddcc75c4030be9fe689f35a2f8d264a7ca5cd60cdd1d Jun 11 15:28:32.926266 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.926209 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:32.979318 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:32.979285 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" event={"ID":"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523","Type":"ContainerStarted","Data":"83c6112b8e1b198ce362ddcc75c4030be9fe689f35a2f8d264a7ca5cd60cdd1d"} Jun 11 15:28:33.203865 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:33.203779 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:34.995002 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:34.994964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" event={"ID":"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523","Type":"ContainerStarted","Data":"1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a"} Jun 11 15:28:34.995456 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:34.995073 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:35.016542 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:35.016494 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" podStartSLOduration=2.043920776 podStartE2EDuration="4.01647576s" totalImagesPullingTime="1.972554984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:35.015117349 +0000 UTC m=+718.400314743" watchObservedRunningTime="2026-06-11 15:28:35.01647576 +0000 UTC m=+718.401673116" Jun 11 15:28:35.567272 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:35.567210 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:36.175779 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:36.175740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:37.014808 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:37.014772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:37.120142 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:37.120109 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:38.011181 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:38.011144 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" event={"ID":"c7934a91-9b3d-4de3-b71c-483bd026e5fe","Type":"ContainerStarted","Data":"fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2"} Jun 11 15:28:38.011607 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:38.011289 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:38.033071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:38.033017 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" podStartSLOduration=1.9781450139999999 podStartE2EDuration="10.033000092s" totalImagesPullingTime="8.054855078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:38.030557676 +0000 UTC m=+721.415755066" watchObservedRunningTime="2026-06-11 15:28:38.033000092 +0000 UTC m=+721.418197471" Jun 11 15:28:38.860269 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:38.860215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:39.962829 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:39.962772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:40.396099 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:40.396061 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:40.496771 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:40.496737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:40.627717 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:40.627681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:41.224690 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:41.224652 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:41.771871 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:41.771831 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:41.831011 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:41.830974 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:46.002819 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:46.002790 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:49.019328 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:49.019295 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:49.432144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:49.432047 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:49.526264 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:49.526204 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:50.651731 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.651699 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq"] Jun 11 15:28:50.652132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.651936 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" containerName="manager" containerID="cri-o://fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2" gracePeriod=2 Jun 11 15:28:50.660075 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.660020 2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c7934a91-9b3d-4de3-b71c-483bd026e5fe\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.660317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.660110 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq"] Jun 11 15:28:50.669318 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.669290 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf"] Jun 11 15:28:50.669712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.669662 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" containerName="manager" containerID="cri-o://1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a" gracePeriod=2 Jun 11 15:28:50.674303 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.673495 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.674554 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.674528 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf"] Jun 11 15:28:50.677678 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.677642 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.680352 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680208 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:28:50.680789 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680767 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" containerName="manager" Jun 11 15:28:50.680789 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680790 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" containerName="manager" Jun 11 15:28:50.680927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680799 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" containerName="manager" Jun 11 15:28:50.680927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680804 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" containerName="manager" Jun 11 15:28:50.680927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680864 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" containerName="manager" Jun 11 15:28:50.680927 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.680871 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" containerName="manager" Jun 11 15:28:50.682614 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.682599 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.684769 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.684744 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.686980 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.686959 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.701784 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.701757 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq"] Jun 11 15:28:50.704149 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.704129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:50.704534 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.704501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:28:50.719446 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.719406 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.720753 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.720724 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq"] Jun 11 15:28:50.721843 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.721812 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.779209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.779180 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.779385 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.779250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcwcp\" (UniqueName: \"kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.779385 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.779290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xpmd\" (UniqueName: \"kubernetes.io/projected/a01085a8-2a10-4b51-b5f5-eae8cef082e1-kube-api-access-9xpmd\") pod \"limitador-operator-controller-manager-859d7b78bd-sf4nq\" (UID: \"a01085a8-2a10-4b51-b5f5-eae8cef082e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:50.879862 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.879825 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk"] Jun 11 15:28:50.880371 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.880341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwcp\" (UniqueName: \"kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.880453 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.880403 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xpmd\" (UniqueName: \"kubernetes.io/projected/a01085a8-2a10-4b51-b5f5-eae8cef082e1-kube-api-access-9xpmd\") pod \"limitador-operator-controller-manager-859d7b78bd-sf4nq\" (UID: \"a01085a8-2a10-4b51-b5f5-eae8cef082e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:50.881643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.880555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.881643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.880958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.882992 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.882971 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:50.885370 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.885337 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.887513 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.887488 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.891477 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.891426 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwcp\" (UniqueName: \"kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dbq46\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:50.891585 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.891554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xpmd\" (UniqueName: \"kubernetes.io/projected/a01085a8-2a10-4b51-b5f5-eae8cef082e1-kube-api-access-9xpmd\") pod \"limitador-operator-controller-manager-859d7b78bd-sf4nq\" (UID: \"a01085a8-2a10-4b51-b5f5-eae8cef082e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:50.903418 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.902713 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk"] Jun 11 15:28:50.929652 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.929624 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.932339 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.932308 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.933017 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.933003 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.935298 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.935275 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.937506 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.937480 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zpvkq\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:50.939680 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:50.939661 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr2wf\" is forbidden: User \"system:node:ip-10-0-133-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-2.ec2.internal' and this object" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:50.981310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981275 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume\") pod \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " Jun 11 15:28:50.981488 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981387 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs85h\" (UniqueName: \"kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h\") pod \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\" (UID: \"c7934a91-9b3d-4de3-b71c-483bd026e5fe\") " Jun 11 15:28:50.981488 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981408 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffkqp\" (UniqueName: \"kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp\") pod \"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523\" (UID: \"f05c0b5e-2b35-4fff-863a-aa0ee1b8c523\") " Jun 11 15:28:50.981613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981550 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5c9\" (UniqueName: \"kubernetes.io/projected/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-kube-api-access-8m5c9\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:50.981613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:50.981904 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.981877 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7934a91-9b3d-4de3-b71c-483bd026e5fe" (UID: "c7934a91-9b3d-4de3-b71c-483bd026e5fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:28:50.983691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.983667 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h" (OuterVolumeSpecName: "kube-api-access-cs85h") pod "c7934a91-9b3d-4de3-b71c-483bd026e5fe" (UID: "c7934a91-9b3d-4de3-b71c-483bd026e5fe"). InnerVolumeSpecName "kube-api-access-cs85h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:28:50.983745 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:50.983701 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp" (OuterVolumeSpecName: "kube-api-access-ffkqp") pod "f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" (UID: "f05c0b5e-2b35-4fff-863a-aa0ee1b8c523"). InnerVolumeSpecName "kube-api-access-ffkqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:28:51.072622 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.072584 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" path="/var/lib/kubelet/pods/c7934a91-9b3d-4de3-b71c-483bd026e5fe/volumes" Jun 11 15:28:51.072919 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.072906 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" path="/var/lib/kubelet/pods/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523/volumes" Jun 11 15:28:51.080925 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.080892 2582 generic.go:356] "Generic (PLEG): container finished" podID="c7934a91-9b3d-4de3-b71c-483bd026e5fe" containerID="fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2" exitCode=0 Jun 11 15:28:51.081072 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.080964 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zpvkq" Jun 11 15:28:51.081072 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.080999 2582 scope.go:117] "RemoveContainer" containerID="fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2" Jun 11 15:28:51.082442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5c9\" (UniqueName: \"kubernetes.io/projected/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-kube-api-access-8m5c9\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:51.082442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:51.082442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082374 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7934a91-9b3d-4de3-b71c-483bd026e5fe-extensions-socket-volume\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:28:51.082442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082395 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs85h\" (UniqueName: \"kubernetes.io/projected/c7934a91-9b3d-4de3-b71c-483bd026e5fe-kube-api-access-cs85h\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:28:51.082442 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082411 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffkqp\" (UniqueName: \"kubernetes.io/projected/f05c0b5e-2b35-4fff-863a-aa0ee1b8c523-kube-api-access-ffkqp\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:28:51.082732 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.082713 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:51.083239 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.083196 2582 generic.go:356] "Generic (PLEG): container finished" podID="f05c0b5e-2b35-4fff-863a-aa0ee1b8c523" containerID="1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a" exitCode=0 Jun 11 15:28:51.083335 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.083256 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr2wf" Jun 11 15:28:51.087383 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.087366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:51.092067 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.092049 2582 scope.go:117] "RemoveContainer" containerID="fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2" Jun 11 15:28:51.092326 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:51.092309 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2\": container with ID starting with fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2 not found: ID does not exist" containerID="fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2" Jun 11 15:28:51.092394 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.092333 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2"} err="failed to get container status \"fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2\": rpc error: code = NotFound desc = could not find container \"fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2\": container with ID starting with fd1372dde4125418b3b2d6c9d3f243f40bab6adb3f662d779c7a74f47f7bf7a2 not found: ID does not exist" Jun 11 15:28:51.092394 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.092349 2582 scope.go:117] "RemoveContainer" containerID="1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a" Jun 11 15:28:51.095271 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.095249 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:51.097823 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.097724 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5c9\" (UniqueName: \"kubernetes.io/projected/f4d425a2-7ae0-4554-acdc-c774f8bfbd17-kube-api-access-8m5c9\") pod \"kuadrant-operator-controller-manager-86878c769f-t9snk\" (UID: \"f4d425a2-7ae0-4554-acdc-c774f8bfbd17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:51.100808 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.100784 2582 scope.go:117] "RemoveContainer" containerID="1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a" Jun 11 15:28:51.101094 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:28:51.101070 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a\": container with ID starting with 1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a not found: ID does not exist" containerID="1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a" Jun 11 15:28:51.101192 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.101098 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a"} err="failed to get container status \"1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a\": rpc error: code = NotFound desc = could not find container \"1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a\": container with ID starting with 1f1cb57dfd691b3111cbb6a4e3379f3876a08aa4e2bdedb61bd2502e9c81ef8a not found: ID does not exist" Jun 11 15:28:51.224617 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.224587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:51.260104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.259936 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:28:51.263511 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:51.263468 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0744ba2_38a7_4c57_bdb4_10474af7b73d.slice/crio-c926618a5736a38817629d4aedbef2dac05c1b2798531a50a18fc593fbc4fa5e WatchSource:0}: Error finding container c926618a5736a38817629d4aedbef2dac05c1b2798531a50a18fc593fbc4fa5e: Status 404 returned error can't find the container with id c926618a5736a38817629d4aedbef2dac05c1b2798531a50a18fc593fbc4fa5e Jun 11 15:28:51.286906 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.286843 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq"] Jun 11 15:28:51.295953 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:51.295920 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01085a8_2a10_4b51_b5f5_eae8cef082e1.slice/crio-b7cc3197dbd057ed311b566203e99f1e13aaccb73ec78d22a904a5d5eb4a5890 WatchSource:0}: Error finding container b7cc3197dbd057ed311b566203e99f1e13aaccb73ec78d22a904a5d5eb4a5890: Status 404 returned error can't find the container with id b7cc3197dbd057ed311b566203e99f1e13aaccb73ec78d22a904a5d5eb4a5890 Jun 11 15:28:51.390418 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.390394 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk"] Jun 11 15:28:51.394473 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:28:51.394439 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d425a2_7ae0_4554_acdc_c774f8bfbd17.slice/crio-6aa55808f32e7f15b5f88f804dab35074ebae2c822faedcecd733d83ffacf77c WatchSource:0}: Error finding container 6aa55808f32e7f15b5f88f804dab35074ebae2c822faedcecd733d83ffacf77c: Status 404 returned error can't find the container with id 6aa55808f32e7f15b5f88f804dab35074ebae2c822faedcecd733d83ffacf77c Jun 11 15:28:51.468123 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.468092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:51.572383 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:51.572348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:52.091481 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.091444 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" event={"ID":"a01085a8-2a10-4b51-b5f5-eae8cef082e1","Type":"ContainerStarted","Data":"507301c9e42a78038dc1cfec8010c011cdf94fbd7d994c9801f653f83f93db5a"} Jun 11 15:28:52.091958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.091494 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" event={"ID":"a01085a8-2a10-4b51-b5f5-eae8cef082e1","Type":"ContainerStarted","Data":"b7cc3197dbd057ed311b566203e99f1e13aaccb73ec78d22a904a5d5eb4a5890"} Jun 11 15:28:52.091958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.091648 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:28:52.093280 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.093256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" event={"ID":"a0744ba2-38a7-4c57-bdb4-10474af7b73d","Type":"ContainerStarted","Data":"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a"} Jun 11 15:28:52.093395 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.093301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" event={"ID":"a0744ba2-38a7-4c57-bdb4-10474af7b73d","Type":"ContainerStarted","Data":"c926618a5736a38817629d4aedbef2dac05c1b2798531a50a18fc593fbc4fa5e"} Jun 11 15:28:52.093395 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.093327 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:28:52.095739 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.095717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" event={"ID":"f4d425a2-7ae0-4554-acdc-c774f8bfbd17","Type":"ContainerStarted","Data":"0b1c0534a8f1c0da90867142db49b772910ab116b3efe4d50ff1c97cfcd0e367"} Jun 11 15:28:52.095854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.095758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" event={"ID":"f4d425a2-7ae0-4554-acdc-c774f8bfbd17","Type":"ContainerStarted","Data":"6aa55808f32e7f15b5f88f804dab35074ebae2c822faedcecd733d83ffacf77c"} Jun 11 15:28:52.095854 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.095810 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:28:52.111386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.111340 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" podStartSLOduration=2.111325407 podStartE2EDuration="2.111325407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:52.109429715 +0000 UTC m=+735.494627093" watchObservedRunningTime="2026-06-11 15:28:52.111325407 +0000 UTC m=+735.496522784" Jun 11 15:28:52.131480 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.131436 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" podStartSLOduration=2.131421403 podStartE2EDuration="2.131421403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:52.130694726 +0000 UTC m=+735.515892103" watchObservedRunningTime="2026-06-11 15:28:52.131421403 +0000 UTC m=+735.516618781" Jun 11 15:28:52.158451 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:52.158395 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" podStartSLOduration=2.158380009 podStartE2EDuration="2.158380009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:52.156827776 +0000 UTC m=+735.542025154" watchObservedRunningTime="2026-06-11 15:28:52.158380009 +0000 UTC m=+735.543577387" Jun 11 15:28:57.985503 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:57.985463 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:58.085122 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:58.085089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:28:58.147140 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:28:58.147095 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:01.782888 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:01.782850 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:01.884942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:01.884854 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:03.101941 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.101913 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9snk" Jun 11 15:29:03.102453 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.102085 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:29:03.102453 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.102157 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sf4nq" Jun 11 15:29:03.156274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.156212 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:29:03.156445 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.156424 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" podUID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" containerName="manager" containerID="cri-o://3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a" gracePeriod=10 Jun 11 15:29:03.406757 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.406732 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:29:03.500308 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.500267 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume\") pod \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " Jun 11 15:29:03.500508 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.500375 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcwcp\" (UniqueName: \"kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp\") pod \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\" (UID: \"a0744ba2-38a7-4c57-bdb4-10474af7b73d\") " Jun 11 15:29:03.500634 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.500608 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0744ba2-38a7-4c57-bdb4-10474af7b73d" (UID: "a0744ba2-38a7-4c57-bdb4-10474af7b73d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:29:03.502613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.502582 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp" (OuterVolumeSpecName: "kube-api-access-rcwcp") pod "a0744ba2-38a7-4c57-bdb4-10474af7b73d" (UID: "a0744ba2-38a7-4c57-bdb4-10474af7b73d"). InnerVolumeSpecName "kube-api-access-rcwcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:29:03.601744 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.601705 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0744ba2-38a7-4c57-bdb4-10474af7b73d-extensions-socket-volume\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:29:03.601744 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:03.601738 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcwcp\" (UniqueName: \"kubernetes.io/projected/a0744ba2-38a7-4c57-bdb4-10474af7b73d-kube-api-access-rcwcp\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:29:04.156220 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.156182 2582 generic.go:356] "Generic (PLEG): container finished" podID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" containerID="3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a" exitCode=0 Jun 11 15:29:04.156712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.156252 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" Jun 11 15:29:04.156712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.156274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" event={"ID":"a0744ba2-38a7-4c57-bdb4-10474af7b73d","Type":"ContainerDied","Data":"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a"} Jun 11 15:29:04.156712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.156344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46" event={"ID":"a0744ba2-38a7-4c57-bdb4-10474af7b73d","Type":"ContainerDied","Data":"c926618a5736a38817629d4aedbef2dac05c1b2798531a50a18fc593fbc4fa5e"} Jun 11 15:29:04.156712 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.156379 2582 scope.go:117] "RemoveContainer" containerID="3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a" Jun 11 15:29:04.171091 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.171068 2582 scope.go:117] "RemoveContainer" containerID="3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a" Jun 11 15:29:04.171398 ip-10-0-133-2 kubenswrapper[2582]: E0611 15:29:04.171375 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a\": container with ID starting with 3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a not found: ID does not exist" containerID="3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a" Jun 11 15:29:04.171470 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.171405 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a"} err="failed to get container status \"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a\": rpc error: code = NotFound desc = could not find container \"3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a\": container with ID starting with 3d8b75abf964b3bc56727423a3222b05334e00f72a441e4f5521298f8d77f33a not found: ID does not exist" Jun 11 15:29:04.184116 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.184093 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:29:04.192795 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:04.192773 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dbq46"] Jun 11 15:29:05.071953 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:05.071918 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" path="/var/lib/kubelet/pods/a0744ba2-38a7-4c57-bdb4-10474af7b73d/volumes" Jun 11 15:29:08.719651 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:08.719617 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:08.822718 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:08.822673 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:11.185718 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:11.185670 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:11.284774 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:11.284730 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:17.717643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:17.717606 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:17.819691 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:17.819648 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:17.918683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:17.918644 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:19.546074 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.546014 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c"] Jun 11 15:29:19.546515 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.546498 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" containerName="manager" Jun 11 15:29:19.546561 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.546517 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" containerName="manager" Jun 11 15:29:19.546595 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.546578 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0744ba2-38a7-4c57-bdb4-10474af7b73d" containerName="manager" Jun 11 15:29:19.549686 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.549667 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.553056 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.553035 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-s5tjx\"" Jun 11 15:29:19.555333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvlf\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-kube-api-access-hfvlf\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555569 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555569 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555567 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555683 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555649 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/549ddffd-d5dd-45e9-8145-45468a721cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555708 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.555844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.555723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.565788 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.565761 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:19.568399 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.568374 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c"] Jun 11 15:29:19.656295 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656295 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/549ddffd-d5dd-45e9-8145-45468a721cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvlf\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-kube-api-access-hfvlf\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656565 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656513 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.656944 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656875 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.657011 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.656964 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.657176 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.657150 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/549ddffd-d5dd-45e9-8145-45468a721cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.657347 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.657206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.657419 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.657354 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.659112 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.659090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.659374 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.659307 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.665657 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.665626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvlf\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-kube-api-access-hfvlf\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.666067 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.666050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/549ddffd-d5dd-45e9-8145-45468a721cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-5gs6c\" (UID: \"549ddffd-d5dd-45e9-8145-45468a721cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.861937 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.861844 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:19.881576 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:19.881544 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:20.011319 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.011292 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c"] Jun 11 15:29:20.013693 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:29:20.013665 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549ddffd_d5dd_45e9_8145_45468a721cb7.slice/crio-ff89bb89cc694a1b12062a8f940aa6fec7fd62558f05e51171f83b17acf1bcef WatchSource:0}: Error finding container ff89bb89cc694a1b12062a8f940aa6fec7fd62558f05e51171f83b17acf1bcef: Status 404 returned error can't find the container with id ff89bb89cc694a1b12062a8f940aa6fec7fd62558f05e51171f83b17acf1bcef Jun 11 15:29:20.015768 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.015733 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:29:20.015869 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.015809 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:29:20.015869 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.015838 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:29:20.237751 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.237663 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" event={"ID":"549ddffd-d5dd-45e9-8145-45468a721cb7","Type":"ContainerStarted","Data":"0f224d15334bd738e3f0b24b04bd6358c6166062c228dd7e000f8069296248f8"} Jun 11 15:29:20.237751 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.237721 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" event={"ID":"549ddffd-d5dd-45e9-8145-45468a721cb7","Type":"ContainerStarted","Data":"ff89bb89cc694a1b12062a8f940aa6fec7fd62558f05e51171f83b17acf1bcef"} Jun 11 15:29:20.265601 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.265553 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" podStartSLOduration=1.26553746 podStartE2EDuration="1.26553746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:20.263532996 +0000 UTC m=+763.648730368" watchObservedRunningTime="2026-06-11 15:29:20.26553746 +0000 UTC m=+763.650734837" Jun 11 15:29:20.862477 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:20.862448 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:21.273908 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.273874 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:21.399212 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.399176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:21.456001 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.455957 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:21.651129 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.651044 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:29:21.653625 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.653611 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.656155 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.656133 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 15:29:21.656155 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.656146 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xr9gv\"" Jun 11 15:29:21.662866 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.662843 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:29:21.672589 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.672554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6s46\" (UniqueName: \"kubernetes.io/projected/75333535-5057-4c8e-8508-a3ec29805324-kube-api-access-w6s46\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.672741 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.672656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75333535-5057-4c8e-8508-a3ec29805324-config-file\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.698114 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.698085 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:29:21.773956 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.773920 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75333535-5057-4c8e-8508-a3ec29805324-config-file\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.774144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.774009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6s46\" (UniqueName: \"kubernetes.io/projected/75333535-5057-4c8e-8508-a3ec29805324-kube-api-access-w6s46\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.774610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.774588 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75333535-5057-4c8e-8508-a3ec29805324-config-file\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.784510 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.784481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6s46\" (UniqueName: \"kubernetes.io/projected/75333535-5057-4c8e-8508-a3ec29805324-kube-api-access-w6s46\") pod \"limitador-limitador-54d6d988d5-5dskh\" (UID: \"75333535-5057-4c8e-8508-a3ec29805324\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:21.867640 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.867609 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:21.948292 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.948182 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:21.965674 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:21.965644 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:22.056046 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.056012 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:22.115107 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.115079 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:29:22.117857 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:29:22.117829 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75333535_5057_4c8e_8508_a3ec29805324.slice/crio-c61b50420a20b1249fe23f464ec3119b9271924594e70ac32831a94189d7e045 WatchSource:0}: Error finding container c61b50420a20b1249fe23f464ec3119b9271924594e70ac32831a94189d7e045: Status 404 returned error can't find the container with id c61b50420a20b1249fe23f464ec3119b9271924594e70ac32831a94189d7e045 Jun 11 15:29:22.250030 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.249997 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" event={"ID":"75333535-5057-4c8e-8508-a3ec29805324","Type":"ContainerStarted","Data":"c61b50420a20b1249fe23f464ec3119b9271924594e70ac32831a94189d7e045"} Jun 11 15:29:22.250317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.250284 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:22.251293 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.251274 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:29:22.372201 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.372170 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:22.433748 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:22.433716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:25.269687 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:25.269650 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" event={"ID":"75333535-5057-4c8e-8508-a3ec29805324","Type":"ContainerStarted","Data":"b16641731e1ffbbae388095f1f9391a58df7ebc6482d829688085d542490900e"} Jun 11 15:29:25.270113 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:25.269754 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:25.289053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:25.289004 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" podStartSLOduration=1.8992139 podStartE2EDuration="4.288989748s" totalImagesPullingTime="2.389775848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:25.286976318 +0000 UTC m=+768.672173698" watchObservedRunningTime="2026-06-11 15:29:25.288989748 +0000 UTC m=+768.674187126" Jun 11 15:29:29.142055 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:29.142012 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:29.242584 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:29.242535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:31.599218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:31.599182 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:31.697549 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:31.697518 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:36.276361 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:36.276333 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5dskh" Jun 11 15:29:38.140396 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:38.140361 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:38.240802 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:38.240764 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:38.298495 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:38.298456 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:42.471413 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:42.471376 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:52.712323 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:52.712279 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:52.810467 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:52.810435 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:52.932610 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:52.932570 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:29:58.893626 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:29:58.893576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:17.583238 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:17.583180 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:17.684398 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:17.684359 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:17.998524 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:17.998489 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:18.001044 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.001026 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:18.003885 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.003858 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:30:18.004024 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.003904 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:30:18.004024 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.003948 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:30:18.005212 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.005193 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2cfn6\"" Jun 11 15:30:18.015209 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.015185 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:18.102582 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.102540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nlp9\" (UniqueName: \"kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9\") pod \"maas-keycloak-0\" (UID: \"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:18.203883 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.203843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nlp9\" (UniqueName: \"kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9\") pod \"maas-keycloak-0\" (UID: \"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:18.214658 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.214630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nlp9\" (UniqueName: \"kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9\") pod \"maas-keycloak-0\" (UID: \"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:18.310833 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.310733 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:18.450346 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.450294 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:18.453141 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:30:18.453112 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ab9d47_d299_41bd_a3cb_ea5cdec63e0c.slice/crio-50cb14fd256630c3449a0f8172d31a0a0d3c3111f1652d5d3f7ca1a1c3e098b3 WatchSource:0}: Error finding container 50cb14fd256630c3449a0f8172d31a0a0d3c3111f1652d5d3f7ca1a1c3e098b3: Status 404 returned error can't find the container with id 50cb14fd256630c3449a0f8172d31a0a0d3c3111f1652d5d3f7ca1a1c3e098b3 Jun 11 15:30:18.534419 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:18.534381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c","Type":"ContainerStarted","Data":"50cb14fd256630c3449a0f8172d31a0a0d3c3111f1652d5d3f7ca1a1c3e098b3"} Jun 11 15:30:24.572892 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:24.572850 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c","Type":"ContainerStarted","Data":"be3ab41be821bd8b83bdd1f354a6f5b0da3c695e8d844cd8f4d3e167dbbabf07"} Jun 11 15:30:24.595128 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:24.595063 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.455422584 podStartE2EDuration="7.595040241s" totalImagesPullingTime="5.139617657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:30:24.59392211 +0000 UTC m=+827.979119489" watchObservedRunningTime="2026-06-11 15:30:24.595040241 +0000 UTC m=+827.980237614" Jun 11 15:30:25.311704 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:25.311657 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:25.313651 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:25.313542 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:26.311826 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:26.311772 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:27.311823 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:27.311762 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:28.311380 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:28.311337 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:28.311939 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:28.311675 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:29.312311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:29.312216 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:30.312120 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:30.312069 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:31.311409 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:31.311361 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:32.311686 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:32.311636 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:33.312072 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:33.312029 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:34.312164 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:34.312106 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:35.311769 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:35.311721 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:36.311630 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:36.311572 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 11 15:30:37.437390 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:37.437356 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:37.456108 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:37.456050 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:30:47.444181 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:47.444138 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:48.084872 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:48.084820 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:48.230694 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:48.230661 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:48.380062 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:48.379967 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:52.191288 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:52.191216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:52.292523 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:52.292484 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:53.482613 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:53.482582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:53.561461 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:53.561417 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:53.613474 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:53.613436 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:53.754606 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:53.754570 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:57.081855 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:57.081812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:30:57.173489 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:30:57.173457 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:09.698588 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:09.698544 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:16.365508 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:16.365476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:16.419612 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:16.419580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:28.158759 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:28.158681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:28.382697 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:28.382655 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:28.798643 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:28.798607 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:28.902246 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:28.902202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:31:28.963990 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:28.963957 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:31:36.968035 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.967910 2582 generic.go:356] "Generic (PLEG): container finished" podID="549ddffd-d5dd-45e9-8145-45468a721cb7" containerID="0f224d15334bd738e3f0b24b04bd6358c6166062c228dd7e000f8069296248f8" exitCode=0 Jun 11 15:31:36.968035 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.967972 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" event={"ID":"549ddffd-d5dd-45e9-8145-45468a721cb7","Type":"ContainerDied","Data":"0f224d15334bd738e3f0b24b04bd6358c6166062c228dd7e000f8069296248f8"} Jun 11 15:31:36.968656 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.968532 2582 scope.go:117] "RemoveContainer" containerID="0f224d15334bd738e3f0b24b04bd6358c6166062c228dd7e000f8069296248f8" Jun 11 15:31:36.969594 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.969564 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:31:36.969692 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.969671 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:31:36.969762 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:36.969741 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:31:37.102814 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:37.102781 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:31:37.105411 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:37.105387 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:31:37.251160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:37.251129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:31:37.974984 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:37.974942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" event={"ID":"549ddffd-d5dd-45e9-8145-45468a721cb7","Type":"ContainerStarted","Data":"870ac917ae28663759d464b23a910d5d86c7245164bb9622b37eed0c4de10eef"} Jun 11 15:31:38.863067 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:38.863021 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:31:38.864200 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:38.864174 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5gs6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 11 15:31:38.864344 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:38.864244 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" podUID="549ddffd-d5dd-45e9-8145-45468a721cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 11 15:31:39.863049 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:39.863009 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5gs6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 11 15:31:39.863590 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:39.863077 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" podUID="549ddffd-d5dd-45e9-8145-45468a721cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 11 15:31:40.862584 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:40.862545 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-5gs6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 11 15:31:40.862777 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:40.862603 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" podUID="549ddffd-d5dd-45e9-8145-45468a721cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 11 15:31:41.866529 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:41.866496 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:31:41.866930 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:41.866764 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:31:41.867410 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:31:41.867396 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-5gs6c" Jun 11 15:33:04.265487 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:04.265400 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:33:04.354937 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:04.354897 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:33:41.072287 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:41.072254 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:41.072841 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:41.072448 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" containerID="cri-o://be3ab41be821bd8b83bdd1f354a6f5b0da3c695e8d844cd8f4d3e167dbbabf07" gracePeriod=30 Jun 11 15:33:42.619105 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.619061 2582 generic.go:356] "Generic (PLEG): container finished" podID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerID="be3ab41be821bd8b83bdd1f354a6f5b0da3c695e8d844cd8f4d3e167dbbabf07" exitCode=143 Jun 11 15:33:42.619500 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.619130 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c","Type":"ContainerDied","Data":"be3ab41be821bd8b83bdd1f354a6f5b0da3c695e8d844cd8f4d3e167dbbabf07"} Jun 11 15:33:42.717893 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.717867 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:42.804746 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.804713 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nlp9\" (UniqueName: \"kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9\") pod \"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c\" (UID: \"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c\") " Jun 11 15:33:42.807110 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.807089 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9" (OuterVolumeSpecName: "kube-api-access-9nlp9") pod "90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" (UID: "90ab9d47-d299-41bd-a3cb-ea5cdec63e0c"). InnerVolumeSpecName "kube-api-access-9nlp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:33:42.906169 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:42.906132 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nlp9\" (UniqueName: \"kubernetes.io/projected/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c-kube-api-access-9nlp9\") on node \"ip-10-0-133-2.ec2.internal\" DevicePath \"\"" Jun 11 15:33:43.626249 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.626188 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.626726 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.626217 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ab9d47-d299-41bd-a3cb-ea5cdec63e0c","Type":"ContainerDied","Data":"50cb14fd256630c3449a0f8172d31a0a0d3c3111f1652d5d3f7ca1a1c3e098b3"} Jun 11 15:33:43.626726 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.626314 2582 scope.go:117] "RemoveContainer" containerID="be3ab41be821bd8b83bdd1f354a6f5b0da3c695e8d844cd8f4d3e167dbbabf07" Jun 11 15:33:43.644862 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.644837 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:43.650573 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.650551 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:43.675058 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.675029 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:43.675458 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.675445 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" Jun 11 15:33:43.675504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.675460 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" Jun 11 15:33:43.675543 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.675527 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" containerName="keycloak" Jun 11 15:33:43.678298 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.678282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.680940 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.680917 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:33:43.681036 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.680920 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:33:43.681036 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.680989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:33:43.681154 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.681058 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 15:33:43.681154 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.680992 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2cfn6\"" Jun 11 15:33:43.688460 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.688440 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:43.814777 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.814731 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6xf9\" (UniqueName: \"kubernetes.io/projected/5c208f61-c27d-46fe-b052-bf74cfa54076-kube-api-access-q6xf9\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.814975 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.814829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5c208f61-c27d-46fe-b052-bf74cfa54076-test-realms\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.915926 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.915826 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6xf9\" (UniqueName: \"kubernetes.io/projected/5c208f61-c27d-46fe-b052-bf74cfa54076-kube-api-access-q6xf9\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.915926 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.915886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5c208f61-c27d-46fe-b052-bf74cfa54076-test-realms\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.916568 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.916550 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5c208f61-c27d-46fe-b052-bf74cfa54076-test-realms\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.927198 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.927165 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6xf9\" (UniqueName: \"kubernetes.io/projected/5c208f61-c27d-46fe-b052-bf74cfa54076-kube-api-access-q6xf9\") pod \"maas-keycloak-0\" (UID: \"5c208f61-c27d-46fe-b052-bf74cfa54076\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:43.989071 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:43.989033 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:44.124827 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.124800 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:33:44.127214 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:33:44.127185 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c208f61_c27d_46fe_b052_bf74cfa54076.slice/crio-c13ce710eb6247ce0d8669659b306c2a020fffc1e191ca4a3c451ff27308426b WatchSource:0}: Error finding container c13ce710eb6247ce0d8669659b306c2a020fffc1e191ca4a3c451ff27308426b: Status 404 returned error can't find the container with id c13ce710eb6247ce0d8669659b306c2a020fffc1e191ca4a3c451ff27308426b Jun 11 15:33:44.128784 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.128766 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:33:44.634449 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.634413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5c208f61-c27d-46fe-b052-bf74cfa54076","Type":"ContainerStarted","Data":"3aba8edee86f994125e655bdaabbdf85a49558142818545dac7e4bab9301bf0e"} Jun 11 15:33:44.634963 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.634475 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5c208f61-c27d-46fe-b052-bf74cfa54076","Type":"ContainerStarted","Data":"c13ce710eb6247ce0d8669659b306c2a020fffc1e191ca4a3c451ff27308426b"} Jun 11 15:33:44.654379 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.654258 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.39147077 podStartE2EDuration="1.654210766s" totalImagesPullingTime="262.739996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:33:44.652438881 +0000 UTC m=+1028.037636259" watchObservedRunningTime="2026-06-11 15:33:44.654210766 +0000 UTC m=+1028.039408152" Jun 11 15:33:44.989913 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.989800 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:44.991553 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:44.991516 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:45.073947 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:45.073907 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ab9d47-d299-41bd-a3cb-ea5cdec63e0c" path="/var/lib/kubelet/pods/90ab9d47-d299-41bd-a3cb-ea5cdec63e0c/volumes" Jun 11 15:33:45.990065 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:45.990015 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:46.990252 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:46.990181 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:47.989860 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:47.989803 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:48.990567 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:48.990512 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:49.990162 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:49.990099 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:50.990244 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:50.990176 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:51.990462 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:51.990407 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:52.989829 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:52.989714 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:53.989951 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:53.989904 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:53.990602 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:53.990191 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:54.990649 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:54.990188 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:55.989638 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:55.989589 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:56.989604 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:56.989550 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 11 15:33:58.098912 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:58.098868 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:33:58.117625 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:33:58.117352 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5c208f61-c27d-46fe-b052-bf74cfa54076" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:34:08.106181 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:08.106149 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:08.718055 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:08.718020 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:08.818755 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:08.818722 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:20.490054 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:20.490016 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:20.587487 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:20.587448 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:28.385835 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:28.385755 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:28.762736 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:28.762695 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:34:38.466317 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.466280 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc"] Jun 11 15:34:38.473310 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.471437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.475824 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.475793 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:34:38.475952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.475793 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:34:38.475952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.475875 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 15:34:38.475952 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.475795 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xznz7\"" Jun 11 15:34:38.481876 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.481644 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc"] Jun 11 15:34:38.546101 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.546058 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:38.583517 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583485 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1216ca0-ac85-4462-9adb-3fe518e38dcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.583708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.583708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.583708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.583708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qk4\" (UniqueName: \"kubernetes.io/projected/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kube-api-access-x4qk4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.583708 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.583705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684647 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1216ca0-ac85-4462-9adb-3fe518e38dcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qk4\" (UniqueName: \"kubernetes.io/projected/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kube-api-access-x4qk4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.684844 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.684781 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.685162 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.685133 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.685411 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.685157 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.685411 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.685268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.687268 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.687246 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1216ca0-ac85-4462-9adb-3fe518e38dcb-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.687435 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.687417 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1216ca0-ac85-4462-9adb-3fe518e38dcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.693788 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.693768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qk4\" (UniqueName: \"kubernetes.io/projected/f1216ca0-ac85-4462-9adb-3fe518e38dcb-kube-api-access-x4qk4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gmzjc\" (UID: \"f1216ca0-ac85-4462-9adb-3fe518e38dcb\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.785577 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.785535 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:38.930386 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.930346 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc"] Jun 11 15:34:38.933122 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:34:38.933087 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1216ca0_ac85_4462_9adb_3fe518e38dcb.slice/crio-ead4b1dd5c6c2183dcb66c5ad6e14255c1ac245604295871fdc640116ab40e09 WatchSource:0}: Error finding container ead4b1dd5c6c2183dcb66c5ad6e14255c1ac245604295871fdc640116ab40e09: Status 404 returned error can't find the container with id ead4b1dd5c6c2183dcb66c5ad6e14255c1ac245604295871fdc640116ab40e09 Jun 11 15:34:38.944653 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:38.944626 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" event={"ID":"f1216ca0-ac85-4462-9adb-3fe518e38dcb","Type":"ContainerStarted","Data":"ead4b1dd5c6c2183dcb66c5ad6e14255c1ac245604295871fdc640116ab40e09"} Jun 11 15:34:39.059928 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:39.059801 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:34:42.585615 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:42.585583 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:42.970830 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:42.970789 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" event={"ID":"f1216ca0-ac85-4462-9adb-3fe518e38dcb","Type":"ContainerStarted","Data":"3cc992738bcc3f3a246e9fa287fad2525d284e3306c5b2e55ca40aea9d4ba5a0"} Jun 11 15:34:43.263958 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:43.263921 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:34:44.982866 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:44.982827 2582 generic.go:356] "Generic (PLEG): container finished" podID="f1216ca0-ac85-4462-9adb-3fe518e38dcb" containerID="3cc992738bcc3f3a246e9fa287fad2525d284e3306c5b2e55ca40aea9d4ba5a0" exitCode=0 Jun 11 15:34:44.983294 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:44.982901 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" event={"ID":"f1216ca0-ac85-4462-9adb-3fe518e38dcb","Type":"ContainerDied","Data":"3cc992738bcc3f3a246e9fa287fad2525d284e3306c5b2e55ca40aea9d4ba5a0"} Jun 11 15:34:46.995995 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:46.995962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" event={"ID":"f1216ca0-ac85-4462-9adb-3fe518e38dcb","Type":"ContainerStarted","Data":"c5d37fc29c0c6f31dc3bae52bbdf1be503e0462566ed45d2c72a9192c26b0f77"} Jun 11 15:34:47.017860 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.017800 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" podStartSLOduration=2.870754958 podStartE2EDuration="9.017781083s" totalImagesPullingTime="4.638496966s" totalInitContainerRuntime="1.508529159s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:34:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:34:47.01636046 +0000 UTC m=+1090.401557838" watchObservedRunningTime="2026-06-11 15:34:47.017781083 +0000 UTC m=+1090.402978439" Jun 11 15:34:47.858657 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.858621 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7"] Jun 11 15:34:47.862532 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.862510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.865218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.865196 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 15:34:47.874860 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.874833 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7"] Jun 11 15:34:47.894838 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.894808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:34:47.984041 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984005 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.984248 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984070 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.984248 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.984356 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984247 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mk25\" (UniqueName: \"kubernetes.io/projected/df06c8a6-fff6-406a-9299-b7291583d615-kube-api-access-9mk25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.984356 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df06c8a6-fff6-406a-9299-b7291583d615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:47.984356 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:47.984345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.085674 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085641 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mk25\" (UniqueName: \"kubernetes.io/projected/df06c8a6-fff6-406a-9299-b7291583d615-kube-api-access-9mk25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df06c8a6-fff6-406a-9299-b7291583d615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.085893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086132 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.086109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086480 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.086258 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.086480 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.086334 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.088188 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.088161 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df06c8a6-fff6-406a-9299-b7291583d615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.088465 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.088449 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df06c8a6-fff6-406a-9299-b7291583d615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.095421 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.095403 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mk25\" (UniqueName: \"kubernetes.io/projected/df06c8a6-fff6-406a-9299-b7291583d615-kube-api-access-9mk25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7\" (UID: \"df06c8a6-fff6-406a-9299-b7291583d615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.174295 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.174177 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:34:48.318678 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.318653 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7"] Jun 11 15:34:48.320563 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:34:48.320534 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf06c8a6_fff6_406a_9299_b7291583d615.slice/crio-373b8ce184587c3f5996a83dea5e8148864bbb700c23a3bf2c99c275a9515dc7 WatchSource:0}: Error finding container 373b8ce184587c3f5996a83dea5e8148864bbb700c23a3bf2c99c275a9515dc7: Status 404 returned error can't find the container with id 373b8ce184587c3f5996a83dea5e8148864bbb700c23a3bf2c99c275a9515dc7 Jun 11 15:34:48.785940 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.785891 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:48.786169 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.785960 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:48.798755 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.798726 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:34:48.965265 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:48.965212 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:34:49.009179 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:49.009136 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" event={"ID":"df06c8a6-fff6-406a-9299-b7291583d615","Type":"ContainerStarted","Data":"e662df31506c365a4c2844456beea13876f01d1f03e99465907d1c179d40434f"} Jun 11 15:34:49.009382 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:49.009192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" event={"ID":"df06c8a6-fff6-406a-9299-b7291583d615","Type":"ContainerStarted","Data":"373b8ce184587c3f5996a83dea5e8148864bbb700c23a3bf2c99c275a9515dc7"} Jun 11 15:34:49.022473 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:34:49.022442 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gmzjc" Jun 11 15:35:01.425823 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:01.425786 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:35:02.562585 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:02.562541 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:35:05.846055 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:05.846021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:35:07.765348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:07.765307 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5dskh"] Jun 11 15:35:12.953645 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:12.953609 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:35:13.008832 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:13.008790 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:35:42.290504 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:42.290469 2582 generic.go:356] "Generic (PLEG): container finished" podID="df06c8a6-fff6-406a-9299-b7291583d615" containerID="e662df31506c365a4c2844456beea13876f01d1f03e99465907d1c179d40434f" exitCode=0 Jun 11 15:35:42.290953 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:42.290547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" event={"ID":"df06c8a6-fff6-406a-9299-b7291583d615","Type":"ContainerDied","Data":"e662df31506c365a4c2844456beea13876f01d1f03e99465907d1c179d40434f"} Jun 11 15:35:45.307839 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:45.307804 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" event={"ID":"df06c8a6-fff6-406a-9299-b7291583d615","Type":"ContainerStarted","Data":"1399211ca432d3429c7263642fcbae4931f6dc6527a4ea08e21f04fdb2edf88c"} Jun 11 15:35:45.327973 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:45.327909 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" podStartSLOduration=2.360230918 podStartE2EDuration="58.327892003s" totalImagesPullingTime="2.79961865s" totalInitContainerRuntime="53.168042435s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:35:45.326266771 +0000 UTC m=+1148.711464148" watchObservedRunningTime="2026-06-11 15:35:45.327892003 +0000 UTC m=+1148.713089381" Jun 11 15:35:48.174771 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.174712 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:35:48.175205 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.174825 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:35:48.187282 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.187252 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:35:48.336156 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.336127 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7" Jun 11 15:35:48.464790 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.464697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:35:48.516241 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:35:48.516193 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:36:37.137323 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:36:37.137274 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:36:37.140788 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:36:37.140767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nfksd_e62e24ac-57a7-40a4-a5f3-4d11c0c63d61/ovn-acl-logging/0.log" Jun 11 15:36:40.283160 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:36:40.283127 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:38:52.451616 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:38:52.451575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:38:52.536686 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:38:52.536654 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:39:28.929464 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:28.929427 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c5fc9dbd9-t64nm_a58ac116-faa2-4962-9bea-a5faf2f7a656/nginx/0.log" Jun 11 15:39:29.679666 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:29.679638 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d47b57f5-l8fsm_0da60e2d-feb3-4ac1-843d-732137bc980f/copy-manifests/0.log" Jun 11 15:39:29.691363 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:29.691322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d47b57f5-l8fsm_0da60e2d-feb3-4ac1-843d-732137bc980f/manager/0.log" Jun 11 15:39:31.659104 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:31.659068 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5f69w_b7acb485-14e4-4342-9fd4-289df4981865/registry-server/0.log" Jun 11 15:39:31.775184 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:31.775022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-t9snk_f4d425a2-7ae0-4554-acdc-c774f8bfbd17/manager/0.log" Jun 11 15:39:31.880260 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:31.880206 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5dskh_75333535-5057-4c8e-8508-a3ec29805324/limitador/0.log" Jun 11 15:39:31.985753 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:31.985661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sf4nq_a01085a8-2a10-4b51-b5f5-eae8cef082e1/manager/0.log" Jun 11 15:39:32.319184 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:32.319149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979559626_1bf15958-e508-447e-85f7-b06ceda891d5/istio-proxy/0.log" Jun 11 15:39:32.754014 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:32.753983 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/1.log" Jun 11 15:39:33.512144 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:33.512115 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-gmzjc_f1216ca0-ac85-4462-9adb-3fe518e38dcb/storage-initializer/0.log" Jun 11 15:39:33.525359 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:33.525328 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-gmzjc_f1216ca0-ac85-4462-9adb-3fe518e38dcb/main/0.log" Jun 11 15:39:33.757053 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:33.757022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7_df06c8a6-fff6-406a-9299-b7291583d615/storage-initializer/0.log" Jun 11 15:39:33.773529 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:33.773459 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cmb7x7_df06c8a6-fff6-406a-9299-b7291583d615/main/0.log" Jun 11 15:39:38.172619 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:38.172584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:39:38.272616 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:38.272577 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" limit=1024 Jun 11 15:39:41.182953 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:41.182920 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bhbvd_12e1f4a6-54bc-4717-9836-fca554a804d7/global-pull-secret-syncer/0.log" Jun 11 15:39:41.230452 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:41.230422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8xc2w_47cf754b-71e5-4472-9250-47085b7c076c/konnectivity-agent/0.log" Jun 11 15:39:41.309277 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:41.309239 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-2.ec2.internal_1ac02efbad501c753c36f4c24a72e8f4/haproxy/0.log" Jun 11 15:39:46.771607 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:46.771576 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5f69w_b7acb485-14e4-4342-9fd4-289df4981865/registry-server/0.log" Jun 11 15:39:46.807458 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:46.807429 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-t9snk_f4d425a2-7ae0-4554-acdc-c774f8bfbd17/manager/0.log" Jun 11 15:39:46.840620 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:46.840591 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5dskh_75333535-5057-4c8e-8508-a3ec29805324/limitador/0.log" Jun 11 15:39:46.871274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:46.871238 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sf4nq_a01085a8-2a10-4b51-b5f5-eae8cef082e1/manager/0.log" Jun 11 15:39:48.372414 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.372362 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/alertmanager/0.log" Jun 11 15:39:48.397218 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.397189 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/config-reloader/0.log" Jun 11 15:39:48.419935 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.419910 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/kube-rbac-proxy-web/0.log" Jun 11 15:39:48.444032 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.443956 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/kube-rbac-proxy/0.log" Jun 11 15:39:48.475597 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.475572 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/kube-rbac-proxy-metric/0.log" Jun 11 15:39:48.504507 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.504479 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/prom-label-proxy/0.log" Jun 11 15:39:48.528579 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.528556 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a4a89b1b-a561-4ebd-9d61-7e8fc501349d/init-config-reloader/0.log" Jun 11 15:39:48.577698 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.577667 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-hrjzv_7fea8725-773d-4fd0-a2ab-93a9b28b02cc/cluster-monitoring-operator/0.log" Jun 11 15:39:48.835908 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.835876 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfncd_f2619a52-677f-4ce2-8341-20ae2cddf0aa/node-exporter/0.log" Jun 11 15:39:48.860492 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.860467 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfncd_f2619a52-677f-4ce2-8341-20ae2cddf0aa/kube-rbac-proxy/0.log" Jun 11 15:39:48.890896 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:48.890870 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfncd_f2619a52-677f-4ce2-8341-20ae2cddf0aa/init-textfile/0.log" Jun 11 15:39:49.111018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.110940 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/prometheus/0.log" Jun 11 15:39:49.132210 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.132184 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/config-reloader/0.log" Jun 11 15:39:49.154046 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.154016 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/thanos-sidecar/0.log" Jun 11 15:39:49.178246 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.178202 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/kube-rbac-proxy-web/0.log" Jun 11 15:39:49.200418 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.200395 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/kube-rbac-proxy/0.log" Jun 11 15:39:49.224349 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.224320 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/kube-rbac-proxy-thanos/0.log" Jun 11 15:39:49.247922 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.247893 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7117c2-7ec1-427f-91d7-4d1bb26f1a64/init-config-reloader/0.log" Jun 11 15:39:49.325942 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.325909 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-5fbkt_55148c08-3191-4b9e-af1b-0f19182f9802/prometheus-operator-admission-webhook/0.log" Jun 11 15:39:49.356796 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.356766 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d46958b75-7fhgb_0d59798a-fd00-4b78-8f78-a8adcc2fdbc0/telemeter-client/0.log" Jun 11 15:39:49.382490 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.382407 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d46958b75-7fhgb_0d59798a-fd00-4b78-8f78-a8adcc2fdbc0/reload/0.log" Jun 11 15:39:49.404119 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.404096 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d46958b75-7fhgb_0d59798a-fd00-4b78-8f78-a8adcc2fdbc0/kube-rbac-proxy/0.log" Jun 11 15:39:49.444080 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.444054 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/thanos-query/0.log" Jun 11 15:39:49.465586 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.465559 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/kube-rbac-proxy-web/0.log" Jun 11 15:39:49.486982 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.486956 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/kube-rbac-proxy/0.log" Jun 11 15:39:49.508298 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.508270 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/prom-label-proxy/0.log" Jun 11 15:39:49.529935 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.529907 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/kube-rbac-proxy-rules/0.log" Jun 11 15:39:49.554348 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:49.554317 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c9b85f5b-2v67h_92f0b4ad-c1bc-46da-af4a-63d8bc50cbde/kube-rbac-proxy-metrics/0.log" Jun 11 15:39:51.026933 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.026898 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p"] Jun 11 15:39:51.031027 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.031006 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.033857 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.033833 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-66kf2\"/\"openshift-service-ca.crt\"" Jun 11 15:39:51.034645 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.034631 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-66kf2\"/\"default-dockercfg-tg9x4\"" Jun 11 15:39:51.034645 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.034639 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-66kf2\"/\"kube-root-ca.crt\"" Jun 11 15:39:51.039275 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.039255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p"] Jun 11 15:39:51.132018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.131976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx74z\" (UniqueName: \"kubernetes.io/projected/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-kube-api-access-wx74z\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.132018 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.132021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-lib-modules\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.132311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.132154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-proc\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.132311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.132185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-sys\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.132311 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.132205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-podres\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232722 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-proc\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232722 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-sys\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232746 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-podres\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx74z\" (UniqueName: \"kubernetes.io/projected/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-kube-api-access-wx74z\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232831 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-lib-modules\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232835 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-proc\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232833 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-sys\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232948 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-podres\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.232987 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.232954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-lib-modules\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.241761 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.241717 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx74z\" (UniqueName: \"kubernetes.io/projected/5de5eb90-4cc3-46b5-be09-1e1858ab36f9-kube-api-access-wx74z\") pod \"perf-node-gather-daemonset-28w7p\" (UID: \"5de5eb90-4cc3-46b5-be09-1e1858ab36f9\") " pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.341693 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.341606 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:51.480955 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.480935 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p"] Jun 11 15:39:51.483757 ip-10-0-133-2 kubenswrapper[2582]: W0611 15:39:51.483731 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5de5eb90_4cc3_46b5_be09_1e1858ab36f9.slice/crio-4c5cd664fcd68fb49c5895d4daaeb7b3943ef2cb5c3ff1abe4d5020e7e9430ed WatchSource:0}: Error finding container 4c5cd664fcd68fb49c5895d4daaeb7b3943ef2cb5c3ff1abe4d5020e7e9430ed: Status 404 returned error can't find the container with id 4c5cd664fcd68fb49c5895d4daaeb7b3943ef2cb5c3ff1abe4d5020e7e9430ed Jun 11 15:39:51.590492 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:51.590460 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" event={"ID":"5de5eb90-4cc3-46b5-be09-1e1858ab36f9","Type":"ContainerStarted","Data":"4c5cd664fcd68fb49c5895d4daaeb7b3943ef2cb5c3ff1abe4d5020e7e9430ed"} Jun 11 15:39:52.597509 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:52.597467 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" event={"ID":"5de5eb90-4cc3-46b5-be09-1e1858ab36f9","Type":"ContainerStarted","Data":"b24cfd136b24f426ea4bdb9b8224e0051af9753ff86b37611f30689fb8772baa"} Jun 11 15:39:52.598043 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:52.597532 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:52.615376 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:52.615327 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" podStartSLOduration=1.615314135 podStartE2EDuration="1.615314135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:39:52.613563315 +0000 UTC m=+1395.998760693" watchObservedRunningTime="2026-06-11 15:39:52.615314135 +0000 UTC m=+1396.000511578" Jun 11 15:39:52.815355 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:52.815322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wz6pr_47bd9080-5edf-47fd-a023-fe2e823dc030/volume-data-source-validator/0.log" Jun 11 15:39:54.018237 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:54.018203 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mr68h_4acabfe7-e803-488f-addb-6f32b5e027dd/dns/0.log" Jun 11 15:39:54.041903 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:54.041881 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mr68h_4acabfe7-e803-488f-addb-6f32b5e027dd/kube-rbac-proxy/0.log" Jun 11 15:39:54.138948 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:54.138918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-drd78_f115fdfc-4114-47c6-a039-02fdcedff852/dns-node-resolver/0.log" Jun 11 15:39:54.724194 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:54.724162 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79cc7d96c5-bghrj_285d9f31-f4bb-4b77-914d-cb8289193630/registry/0.log" Jun 11 15:39:54.772369 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:54.772339 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97hsr_69a50c7e-70ba-49e7-bac2-00d48cabd21f/node-ca/0.log" Jun 11 15:39:55.758783 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:55.758752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979559626_1bf15958-e508-447e-85f7-b06ceda891d5/istio-proxy/0.log" Jun 11 15:39:55.883946 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:55.883918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/1.log" Jun 11 15:39:55.884347 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:55.884332 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/0.log" Jun 11 15:39:56.621978 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:56.621949 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z6zsj_038adfb6-d968-4415-938f-2e8621f90f64/serve-healthcheck-canary/0.log" Jun 11 15:39:57.158333 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:57.158299 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wvbs5_424b4b65-0e4c-4112-9535-9482a6641cc3/insights-operator/0.log" Jun 11 15:39:57.159314 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:57.159291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wvbs5_424b4b65-0e4c-4112-9535-9482a6641cc3/insights-operator/1.log" Jun 11 15:39:57.260871 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:57.260839 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pt486_1c3a8a1f-9b00-417c-aa2b-db22a8886e31/kube-rbac-proxy/0.log" Jun 11 15:39:57.289192 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:57.289163 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pt486_1c3a8a1f-9b00-417c-aa2b-db22a8886e31/exporter/0.log" Jun 11 15:39:57.317302 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:57.317273 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pt486_1c3a8a1f-9b00-417c-aa2b-db22a8886e31/extractor/0.log" Jun 11 15:39:58.613876 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:58.613846 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-66kf2/perf-node-gather-daemonset-28w7p" Jun 11 15:39:59.685447 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:59.685418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c5fc9dbd9-t64nm_a58ac116-faa2-4962-9bea-a5faf2f7a656/nginx/0.log" Jun 11 15:39:59.914744 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:59.914714 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d47b57f5-l8fsm_0da60e2d-feb3-4ac1-843d-732137bc980f/manager/0.log" Jun 11 15:39:59.931441 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:39:59.931414 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75d47b57f5-l8fsm_0da60e2d-feb3-4ac1-843d-732137bc980f/copy-manifests/0.log" Jun 11 15:40:01.800919 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:01.800869 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-779bc94b4d-jnhqq_fbdf16fe-c7c2-4cd2-be27-89d7abad2ed2/manager/0.log" Jun 11 15:40:06.186992 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:06.186963 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979559626_1bf15958-e508-447e-85f7-b06ceda891d5/istio-proxy/0.log" Jun 11 15:40:06.275736 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:06.275701 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/1.log" Jun 11 15:40:06.276047 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:06.276032 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/0.log" Jun 11 15:40:07.232974 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.232941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-j722x_8edc0b65-e12d-4577-b872-35cf338684d2/migrator/0.log" Jun 11 15:40:07.255893 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.255853 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-j722x_8edc0b65-e12d-4577-b872-35cf338684d2/graceful-termination/0.log" Jun 11 15:40:07.445507 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.445474 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979559626_1bf15958-e508-447e-85f7-b06ceda891d5/istio-proxy/0.log" Jun 11 15:40:07.536649 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.536597 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/1.log" Jun 11 15:40:07.536943 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.536927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/0.log" Jun 11 15:40:07.678674 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.678636 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-55kw2_6165b866-1b23-4d51-a2c3-0313574aa02f/kube-storage-version-migrator-operator/1.log" Jun 11 15:40:07.679468 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:07.679450 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-55kw2_6165b866-1b23-4d51-a2c3-0313574aa02f/kube-storage-version-migrator-operator/0.log" Jun 11 15:40:09.201734 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.201691 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979559626_1bf15958-e508-447e-85f7-b06ceda891d5/istio-proxy/0.log" Jun 11 15:40:09.285447 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.285422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/1.log" Jun 11 15:40:09.285873 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.285860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-5gs6c_549ddffd-d5dd-45e9-8145-45468a721cb7/istio-proxy/0.log" Jun 11 15:40:09.380136 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.380107 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/kube-multus-additional-cni-plugins/0.log" Jun 11 15:40:09.405796 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.405738 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/egress-router-binary-copy/0.log" Jun 11 15:40:09.437368 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.437344 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/cni-plugins/0.log" Jun 11 15:40:09.465109 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.465035 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/bond-cni-plugin/0.log" Jun 11 15:40:09.489130 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.489106 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/routeoverride-cni/0.log" Jun 11 15:40:09.511640 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.511617 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/whereabouts-cni-bincopy/0.log" Jun 11 15:40:09.532274 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.532250 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfqrc_ef8ec378-c59e-4edd-a584-f631e3e17452/whereabouts-cni/0.log" Jun 11 15:40:09.596605 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.596577 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qx7n7_a39d6f51-6c90-49ee-baeb-c550124daa32/kube-multus/0.log" Jun 11 15:40:09.670235 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.670188 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-crdqt_b359b556-ed0c-45db-b6a9-0e23e66c8456/network-metrics-daemon/0.log" Jun 11 15:40:09.694420 ip-10-0-133-2 kubenswrapper[2582]: I0611 15:40:09.694390 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-crdqt_b359b556-ed0c-45db-b6a9-0e23e66c8456/kube-rbac-proxy/0.log"