Jun 11 16:54:37.894205 ip-10-0-133-82 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:54:38.346679 ip-10-0-133-82 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:38.346679 ip-10-0-133-82 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:54:38.346679 ip-10-0-133-82 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:38.346679 ip-10-0-133-82 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:54:38.346679 ip-10-0-133-82 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:54:38.347823 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.346766 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:54:38.351484 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351465 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.351484 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351482 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351486 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351490 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351493 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351497 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351506 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351511 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351514 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351516 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351520 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351524 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351528 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351531 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351534 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351537 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351540 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351543 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351546 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351549 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.351554 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351551 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351554 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351557 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351559 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351563 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351565 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351568 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351571 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351573 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351576 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351579 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351581 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351584 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351586 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351590 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351593 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351596 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351598 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351601 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351604 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.352016 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351608 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351611 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351614 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351617 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351619 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351622 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351624 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351626 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351629 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351631 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351634 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351638 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351641 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351644 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351647 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351650 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351653 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351656 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351658 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.352497 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351661 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351663 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351666 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351668 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351671 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351673 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351679 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351681 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351684 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351687 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351689 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351692 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351695 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351697 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351701 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351703 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351706 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351708 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351711 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.352979 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351714 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351716 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351719 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351721 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351724 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351726 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351729 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351733 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351736 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351739 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351742 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351744 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351747 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351749 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351752 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351754 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351757 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351759 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351763 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.351765 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.353505 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352511 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352518 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352522 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352525 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352528 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352531 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352534 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352537 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352540 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352543 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352545 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352548 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352551 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352554 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352557 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352559 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352562 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352564 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352567 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352579 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352583 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.353999 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352586 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352588 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352591 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352594 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352599 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352602 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352604 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352606 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352609 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352611 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352614 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352617 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352621 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352625 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352628 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352631 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352634 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352637 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.354519 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352640 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352644 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352648 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352652 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352655 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352658 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352661 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352664 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352667 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352669 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352672 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352674 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352677 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352680 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352682 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352685 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352687 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352690 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.354991 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352692 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352695 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352698 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352700 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352703 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352706 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352708 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352711 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352713 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352716 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352718 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352721 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352723 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352726 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352729 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352731 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352734 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352737 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352740 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352744 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.355440 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352748 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352752 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352755 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352758 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352761 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352763 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352766 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352768 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352771 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352774 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352777 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352779 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352782 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352784 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352787 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352789 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352793 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352795 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352798 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.355944 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352800 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.352803 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353224 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353230 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353233 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353241 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353244 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353248 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353250 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353253 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353261 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353264 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353267 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353269 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353272 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353275 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353277 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353292 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353295 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353298 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.356392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353301 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353304 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353307 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353310 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353313 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353315 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353318 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353321 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353323 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353326 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353329 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353332 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353334 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353337 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353340 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353342 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353344 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353349 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353351 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353355 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.356877 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353358 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353360 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353364 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353367 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353370 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353372 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353375 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353377 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353380 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353382 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353385 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353387 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353392 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353396 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353398 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353401 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353404 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353407 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353411 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.357381 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353414 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353417 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353420 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353423 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353426 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353429 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353431 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353434 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353437 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353440 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353443 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353446 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353450 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353452 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353455 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353459 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353463 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353466 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353469 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.357839 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353472 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353474 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353477 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353480 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353482 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353485 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353487 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353490 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353492 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353495 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353497 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353500 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353502 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353505 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353508 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353510 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353513 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353516 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353519 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353521 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.358436 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353524 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353526 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.353529 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353601 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353609 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353615 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353620 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353624 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353629 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353633 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353638 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353641 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353644 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353647 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353651 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353654 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353657 2579 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353660 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353663 2579 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353666 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353669 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353674 2579 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353677 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353680 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:54:38.358961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353683 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353686 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353690 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353693 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353696 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353699 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353703 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353706 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353708 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353712 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353714 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353720 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353723 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353726 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353729 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353732 2579 flags.go:64] FLAG: --enable-server="true" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353736 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353741 2579 flags.go:64] FLAG: --event-burst="100" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353744 2579 flags.go:64] FLAG: --event-qps="50" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353747 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353750 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353753 2579 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353757 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353760 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353763 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:54:38.359532 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353766 2579 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353769 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353771 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353774 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353777 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353780 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353783 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353786 2579 flags.go:64] FLAG: --feature-gates="" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353789 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353793 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353796 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353799 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353802 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353805 2579 flags.go:64] FLAG: --help="false" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353808 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353811 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353814 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353817 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353822 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353826 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353829 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353831 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353834 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:54:38.360168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353837 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353840 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353844 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353847 2579 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353850 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353853 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353856 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353858 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353861 2579 flags.go:64] FLAG: --lock-file="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353864 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353867 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353870 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353876 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353878 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353881 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353884 2579 flags.go:64] FLAG: --logging-format="text" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353887 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353890 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353893 2579 flags.go:64] FLAG: --manifest-url="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353896 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353900 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353903 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353920 2579 flags.go:64] FLAG: --max-pods="110" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353923 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353926 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:54:38.360809 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353929 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353932 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353936 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353939 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353942 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353949 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353952 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353955 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353958 2579 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353961 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353967 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353970 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353973 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353976 2579 flags.go:64] FLAG: --port="10250" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353979 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353982 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8507e0b5ee8b63d" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353985 2579 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353988 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353991 2579 flags.go:64] FLAG: --register-node="true" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353994 2579 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.353998 2579 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354001 2579 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354003 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354006 2579 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354010 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:54:38.361669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354014 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354017 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354020 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354022 2579 flags.go:64] FLAG: --runonce="false" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354025 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354028 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354031 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354034 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354037 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354040 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354044 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354047 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354050 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354053 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354057 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354060 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354062 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354065 2579 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354069 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354074 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354076 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354079 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354084 2579 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354087 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354090 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:54:38.362634 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354092 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354095 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354098 2579 flags.go:64] FLAG: --v="2" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354102 2579 flags.go:64] FLAG: --version="false" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354106 2579 flags.go:64] FLAG: --vmodule="" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354109 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.354113 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354230 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354233 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354236 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354240 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354244 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354247 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354250 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354253 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354255 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354258 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354261 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354263 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354266 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.363685 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354269 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354275 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354279 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354282 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354285 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354288 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354291 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354293 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354296 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354299 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354301 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354304 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354307 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354309 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354312 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354314 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354317 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354320 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354322 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354324 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.364522 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354327 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354329 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354332 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354335 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354337 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354340 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354342 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354345 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354348 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354350 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354353 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354355 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354358 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354362 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354365 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354368 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354371 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354373 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354376 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.365278 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354378 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354381 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354383 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354386 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354389 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354392 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354394 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354396 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354399 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354401 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354404 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354406 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354409 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354412 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354416 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354420 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354423 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354425 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354428 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.365748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354430 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354433 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354435 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354438 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354441 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354443 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354446 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354450 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354452 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354455 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354458 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354460 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354463 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354465 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354468 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354471 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354473 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354476 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354478 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354481 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354483 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.366232 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354486 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354488 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354491 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354493 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354496 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354498 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.354501 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.355298 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.365511 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.365532 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.365549 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.365555 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365621 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365626 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.366748 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365630 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365633 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365636 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365639 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365642 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365645 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365648 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365650 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365653 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365657 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365661 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365664 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365668 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365670 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365673 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365678 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365681 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365684 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.367137 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365686 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365689 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365691 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365694 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365697 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365700 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365702 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365706 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365711 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365714 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365716 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365719 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365722 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365725 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365728 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365731 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365734 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365737 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365739 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365742 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.367601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365744 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365748 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365750 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365753 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365756 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365759 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365763 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365765 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365768 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365771 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365773 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365776 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365780 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365783 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365787 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365790 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365793 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365797 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.368102 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365801 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365803 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365807 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365810 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365812 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365815 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365818 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365820 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365823 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365825 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365828 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365830 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365833 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365836 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365838 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365841 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365843 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365846 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365848 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365851 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.368583 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365854 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365857 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365859 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365862 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365865 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365867 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365870 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365872 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365875 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365878 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365880 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365883 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365886 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365889 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365891 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365894 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365896 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365899 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365902 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.369140 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.365904 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.365927 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366054 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366060 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366063 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366065 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366068 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366071 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366074 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366076 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366079 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366082 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366084 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366087 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366090 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:54:38.369601 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366093 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366095 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366098 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366100 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366103 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366106 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366109 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366111 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366114 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366117 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366120 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366122 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366125 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366128 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366130 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366133 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366135 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366138 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366141 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366143 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:54:38.370201 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366146 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366148 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366152 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366156 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366159 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366163 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366166 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366168 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366171 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366175 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366178 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366181 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366185 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366188 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366191 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366193 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366196 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366199 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366202 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:54:38.370707 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366204 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366207 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366210 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366213 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366215 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366218 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366221 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366225 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366228 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366231 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366234 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366237 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366240 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366243 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366246 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366249 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366251 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366254 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366257 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366259 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:54:38.371183 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366262 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366264 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366269 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366272 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366279 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366282 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366285 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366287 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366291 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366294 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366297 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366299 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366302 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366304 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366307 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366310 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366312 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366315 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366317 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:54:38.371672 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366320 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366322 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366325 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366327 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366330 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366332 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:38.366335 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.366340 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.366470 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.368664 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.370308 2579 server.go:1019] "Starting client certificate rotation" Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.370415 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:54:38.372168 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.370448 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:54:38.372988 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.372973 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:54:38.374250 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.374228 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:54:38.384665 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.384639 2579 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:54:38.389125 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.389107 2579 log.go:25] "Validated CRI v1 image API" Jun 11 16:54:38.390611 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.390585 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:54:38.393562 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.393541 2579 fs.go:135] Filesystem UUIDs: map[1c032ce0-ba34-4ec6-94f6-e99aba38831f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 893f2f31-a918-4bbe-a813-b562114a5922:/dev/nvme0n1p3] Jun 11 16:54:38.393652 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.393560 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:54:38.399505 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.399482 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:54:38.399608 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.399404 2579 manager.go:216] Machine: {Timestamp:2026-06-11 16:54:38.397985101 +0000 UTC m=+0.374940790 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106316 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec252b22cd60f796559ab5868386ccce SystemUUID:ec252b22-cd60-f796-559a-b5868386ccce BootID:ecee6958-7980-46ea-9c41-4497f260d18d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:d3:2c:97:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:d3:2c:97:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:b1:fc:8f:95:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:54:38.399608 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.399546 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:54:38.399727 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.399648 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:54:38.403115 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403090 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:54:38.403274 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403118 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:54:38.403880 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403870 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:54:38.403931 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403883 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:54:38.403931 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403891 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:54:38.403931 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.403904 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:54:38.404833 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.404823 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:54:38.408058 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408041 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:54:38.408183 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408173 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:54:38.408220 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408204 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:54:38.408252 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408223 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:54:38.408252 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408237 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:54:38.408252 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408248 2579 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:54:38.408349 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408257 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:54:38.408692 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408680 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:54:38.408739 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.408698 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:54:38.411469 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.411453 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:54:38.413034 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.413020 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:54:38.413141 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.413057 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:54:38.414100 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414088 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414105 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414112 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414117 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414127 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414133 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414141 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:54:38.414144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414146 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:54:38.414325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414153 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:54:38.414325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414159 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:54:38.414325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414168 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:54:38.414325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.414173 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:54:38.415037 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.415027 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:54:38.415037 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.415037 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:54:38.418302 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.418239 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:54:38.418579 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.418564 2579 server.go:1268] "Started kubelet" Jun 11 16:54:38.418854 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.418826 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:54:38.418939 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.418927 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:54:38.419066 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.418934 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:54:38.419667 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.419321 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:54:38.419667 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.419305 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:54:38.419621 ip-10-0-133-82 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:54:38.420710 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.420696 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:54:38.420828 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.420811 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:54:38.424952 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.423731 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-82.ec2.internal.18b8151fad2bc703 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-82.ec2.internal,UID:ip-10-0-133-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-82.ec2.internal,},FirstTimestamp:2026-06-11 16:54:38.418528003 +0000 UTC m=+0.395483672,LastTimestamp:2026-06-11 16:54:38.418528003 +0000 UTC m=+0.395483672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-82.ec2.internal,}" Jun 11 16:54:38.426067 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.426041 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwrdj" Jun 11 16:54:38.426265 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.426250 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:54:38.426736 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.426721 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:54:38.426736 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.426724 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:54:38.426829 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.426821 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.427319 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427303 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:54:38.427403 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427372 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:54:38.427403 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427390 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:54:38.427563 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427547 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:54:38.427563 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427562 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:54:38.427745 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427727 2579 factory.go:55] Registering systemd factory Jun 11 16:54:38.427818 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427746 2579 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:54:38.427963 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427949 2579 factory.go:153] Registering CRI-O factory Jun 11 16:54:38.428024 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.427967 2579 factory.go:223] Registration of the crio container factory successfully Jun 11 16:54:38.428024 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.428018 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:54:38.428115 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.428041 2579 factory.go:103] Registering Raw factory Jun 11 16:54:38.428115 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.428058 2579 manager.go:1196] Started watching for new ooms in manager Jun 11 16:54:38.428551 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.428538 2579 manager.go:349] Starting recovery of all containers Jun 11 16:54:38.432205 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.432174 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwrdj" Jun 11 16:54:38.438212 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.438177 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:54:38.440071 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.439834 2579 manager.go:354] Recovery completed Jun 11 16:54:38.440218 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.440198 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:38.443025 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.442867 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-82.ec2.internal\" not found" node="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.445196 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.445183 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.447521 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.447502 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.447605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.447539 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.447605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.447554 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.448108 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.448091 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:54:38.448108 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.448102 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.448188 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.448102 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:54:38.448188 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.448142 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:54:38.449026 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449008 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.449087 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449040 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.449087 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449051 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.449243 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449232 2579 policy_none.go:49] "None policy: Start" Jun 11 16:54:38.449280 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449248 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:54:38.449280 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.449259 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:54:38.450326 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.450315 2579 policy_none.go:47] "Start" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.487686 2579 manager.go:337] "Starting Device Plugin manager" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.487874 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.487887 2579 server.go:87] "Starting device plugin registration server" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.488135 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.488145 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.488258 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.488331 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.488337 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.488989 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:54:38.499030 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.489035 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.500728 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.500710 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:54:38.500782 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.500752 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:54:38.500782 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.500773 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:54:38.500848 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.500806 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:54:38.503159 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.503136 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:38.588759 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.588725 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.589697 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.589681 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.589790 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.589736 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.589790 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.589751 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.589790 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.589773 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.599418 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.599356 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.599418 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.599394 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-82.ec2.internal\": node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.601296 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.601280 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal"] Jun 11 16:54:38.601350 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.601340 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.602363 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.602345 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.602443 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.602379 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.602443 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.602393 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.603693 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.603681 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.603801 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.603788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.603834 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.603816 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.605543 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605526 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.605543 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605549 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.605748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605576 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.605748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605588 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.605748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605553 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.605748 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.605652 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.606904 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.606883 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.607001 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.606935 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:54:38.608539 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.608522 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:54:38.608624 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.608551 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:54:38.608624 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.608566 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:54:38.615122 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.615104 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.629388 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.629357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48789ea73209d8607b1fc3fcf49c9cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-82.ec2.internal\" (UID: \"48789ea73209d8607b1fc3fcf49c9cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.629388 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.629387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.629580 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.629414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.630855 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.630836 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-82.ec2.internal\" not found" node="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.635589 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.635573 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-82.ec2.internal\" not found" node="ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.715619 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.715591 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.730339 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48789ea73209d8607b1fc3fcf49c9cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-82.ec2.internal\" (UID: \"48789ea73209d8607b1fc3fcf49c9cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.730422 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.730422 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.730422 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.730422 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48789ea73209d8607b1fc3fcf49c9cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-82.ec2.internal\" (UID: \"48789ea73209d8607b1fc3fcf49c9cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.730560 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.730426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/859aedd1a2f15ceb391480181fea78bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal\" (UID: \"859aedd1a2f15ceb391480181fea78bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.816241 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.816198 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.917015 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:38.916955 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:38.935450 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.935426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:38.939520 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:38.939503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:39.017080 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.017027 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:39.117547 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.117522 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:39.218098 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.218027 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-82.ec2.internal\" not found" Jun 11 16:54:39.253514 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.253488 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:39.295683 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.294357 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:39.327189 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.327157 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" Jun 11 16:54:39.340617 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.340595 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:54:39.341999 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.341984 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" Jun 11 16:54:39.351828 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.351808 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:54:39.370024 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.369980 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:54:39.370191 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.370139 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:54:39.370191 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.370172 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:54:39.370258 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.370170 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:54:39.370258 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.370192 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:54:39.409336 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.409302 2579 apiserver.go:52] "Watching apiserver" Jun 11 16:54:39.422256 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.422218 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:54:39.423578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.423556 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-gq2cz","kube-system/global-pull-secret-syncer-fj4ck","openshift-cluster-node-tuning-operator/tuned-nprj5","openshift-dns/node-resolver-vbphz","openshift-image-registry/node-ca-22qsf","openshift-multus/multus-qdqxx","openshift-network-diagnostics/network-check-target-tdtjg","openshift-network-operator/iptables-alerter-hrdk5","openshift-ovn-kubernetes/ovnkube-node-vgjbk","kube-system/konnectivity-agent-5887v","kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal","openshift-multus/multus-additional-cni-plugins-tr5qv"] Jun 11 16:54:39.424730 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.424715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:39.424812 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.424792 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:39.425797 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.425774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.426796 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.426771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.426925 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.426876 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:54:39.427721 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.427699 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.428793 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.428771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.429871 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.429854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.430782 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.430761 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.430867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.430828 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wc74x\"" Jun 11 16:54:39.431006 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.430989 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6vlwf\"" Jun 11 16:54:39.431141 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.431126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.432276 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.432379 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.432318 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:39.432379 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.432489 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432456 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.432489 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432474 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.432698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432681 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:54:39.432873 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-modprobe-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.432961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysconfig\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.432961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-kubernetes\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.432961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-run\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.432961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7fkr\" (UniqueName: \"kubernetes.io/projected/804f28ca-7cf6-4c34-9dda-1606099c9140-kube-api-access-s7fkr\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40aed566-4224-4280-a5b1-b13adfda62de-hosts-file\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.432989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40aed566-4224-4280-a5b1-b13adfda62de-tmp-dir\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-iptables-alerter-script\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs5n6\" (UniqueName: \"kubernetes.io/projected/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-kube-api-access-vs5n6\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-lib-modules\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-host\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433124 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-tuned\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c5qg\" (UniqueName: \"kubernetes.io/projected/40aed566-4224-4280-a5b1-b13adfda62de-kube-api-access-2c5qg\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433209 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433223 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-conf\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-systemd\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-sys\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-var-lib-kubelet\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433481 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-tmp\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.433793 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-host-slash\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.433793 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.433576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.433793 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.433620 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:39.434601 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.434584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:54:39.434681 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.434629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.434977 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.434815 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.434977 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.434820 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z8gtt\"" Jun 11 16:54:39.434977 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.434879 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.435169 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435087 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:54:39.435249 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.435249 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zwj4g\"" Jun 11 16:54:39.435455 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435287 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:54:39.435455 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435298 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.435455 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435238 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.435864 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435791 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-djn5v\"" Jun 11 16:54:39.435864 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.435844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436153 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b6r7d\"" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436849 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:49:38 +0000 UTC" deadline="2028-01-16 16:48:25.265045572 +0000 UTC" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.436944 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14015h53m45.828106963s" Jun 11 16:54:39.437742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.437539 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:54:39.438400 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.438347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.442514 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:54:39.442897 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442756 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jlvtv\"" Jun 11 16:54:39.442897 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442788 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:54:39.442897 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442838 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:54:39.442897 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442886 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z29md\"" Jun 11 16:54:39.443134 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:54:39.443134 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442920 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:54:39.443134 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.442919 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:54:39.443134 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.443023 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:54:39.443258 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.443244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mwqks\"" Jun 11 16:54:39.452452 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.452433 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:54:39.470953 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.470889 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859aedd1a2f15ceb391480181fea78bc.slice/crio-2446c7b229e729b3b4843d4182dd6149f3586adcdb4661afd85356f81440bc6a WatchSource:0}: Error finding container 2446c7b229e729b3b4843d4182dd6149f3586adcdb4661afd85356f81440bc6a: Status 404 returned error can't find the container with id 2446c7b229e729b3b4843d4182dd6149f3586adcdb4661afd85356f81440bc6a Jun 11 16:54:39.471106 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.471092 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48789ea73209d8607b1fc3fcf49c9cc9.slice/crio-c954f24b13d06a8e8c1f9523ea5a94f68a750942fd437701bfaf04c2a014dbe6 WatchSource:0}: Error finding container c954f24b13d06a8e8c1f9523ea5a94f68a750942fd437701bfaf04c2a014dbe6: Status 404 returned error can't find the container with id c954f24b13d06a8e8c1f9523ea5a94f68a750942fd437701bfaf04c2a014dbe6 Jun 11 16:54:39.475159 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.475142 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wq4n2" Jun 11 16:54:39.479080 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.479045 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:54:39.488158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.488134 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wq4n2" Jun 11 16:54:39.504045 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.504004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" event={"ID":"859aedd1a2f15ceb391480181fea78bc","Type":"ContainerStarted","Data":"2446c7b229e729b3b4843d4182dd6149f3586adcdb4661afd85356f81440bc6a"} Jun 11 16:54:39.505044 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.505019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" event={"ID":"48789ea73209d8607b1fc3fcf49c9cc9","Type":"ContainerStarted","Data":"c954f24b13d06a8e8c1f9523ea5a94f68a750942fd437701bfaf04c2a014dbe6"} Jun 11 16:54:39.528534 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.528505 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:54:39.534161 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-systemd\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.534227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40aed566-4224-4280-a5b1-b13adfda62de-tmp-dir\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.534227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.534227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-multus\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-slash\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctrz\" (UniqueName: \"kubernetes.io/projected/df15ac63-af5f-438e-b960-dc42622b9864-kube-api-access-mctrz\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-iptables-alerter-script\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-systemd\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs5n6\" (UniqueName: \"kubernetes.io/projected/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-kube-api-access-vs5n6\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.534345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64zs\" (UniqueName: \"kubernetes.io/projected/e32fa497-fc6c-47eb-8b1e-be23da06da64-kube-api-access-p64zs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94273d18-2c00-461d-bec8-c84507ac7cc0-agent-certs\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-kubelet\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-node-log\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40aed566-4224-4280-a5b1-b13adfda62de-tmp-dir\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df15ac63-af5f-438e-b960-dc42622b9864-ovn-node-metrics-cert\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-os-release\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-os-release\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.534578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bw8f\" (UniqueName: \"kubernetes.io/projected/3ea8f168-41d5-4192-9196-4ccab6ff022d-kube-api-access-7bw8f\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-conf\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0482ee12-b8a6-451a-9cbb-c70fc7435a62-host\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-conf-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-host-slash\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-kubernetes\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-host-slash\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-bin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysctl-conf\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-kubernetes\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv9h2\" (UniqueName: \"kubernetes.io/projected/ce3db5f5-7012-41e6-85cb-f2afb8af4224-kube-api-access-kv9h2\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-device-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-sys-fs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.535112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.534990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-kubelet\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-netns\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94273d18-2c00-461d-bec8-c84507ac7cc0-konnectivity-ca\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-cni-binary-copy\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-daemon-config\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0482ee12-b8a6-451a-9cbb-c70fc7435a62-serviceca\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-sys\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-bin\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-run\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-socket-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-script-lib\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535213 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-sys\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-binary-copy\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535244 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-run\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-lib-modules\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-host\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.535811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-host\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-lib-modules\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-netd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-config\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-system-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-k8s-cni-cncf-io\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-registration-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzhxk\" (UniqueName: \"kubernetes.io/projected/0482ee12-b8a6-451a-9cbb-c70fc7435a62-kube-api-access-fzhxk\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-dbus\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szr5\" (UniqueName: \"kubernetes.io/projected/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-kube-api-access-4szr5\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-log-socket\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-var-lib-kubelet\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-tmp\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-var-lib-kubelet\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40aed566-4224-4280-a5b1-b13adfda62de-hosts-file\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.536627 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-systemd-units\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40aed566-4224-4280-a5b1-b13adfda62de-hosts-file\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-etc-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-kubelet-config\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-modprobe-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535864 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysconfig\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7fkr\" (UniqueName: \"kubernetes.io/projected/804f28ca-7cf6-4c34-9dda-1606099c9140-kube-api-access-s7fkr\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-sysconfig\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-modprobe-d\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.535995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-system-cni-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-hostroot\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-iptables-alerter-script\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-etc-kubernetes\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-ovn\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537230 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-env-overrides\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-tuned\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-systemd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cnibin\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-cnibin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-var-lib-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-socket-dir-parent\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-netns\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-multus-certs\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.537686 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.536429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c5qg\" (UniqueName: \"kubernetes.io/projected/40aed566-4224-4280-a5b1-b13adfda62de-kube-api-access-2c5qg\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.538854 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.538836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-tmp\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.538945 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.538926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/804f28ca-7cf6-4c34-9dda-1606099c9140-etc-tuned\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.544546 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.544526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs5n6\" (UniqueName: \"kubernetes.io/projected/a71b47b9-9fc9-48cc-9592-3d39926c5f6b-kube-api-access-vs5n6\") pod \"iptables-alerter-hrdk5\" (UID: \"a71b47b9-9fc9-48cc-9592-3d39926c5f6b\") " pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.550459 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.550433 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:39.550459 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.550455 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:39.550613 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.550467 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:39.550613 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.550538 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.050517791 +0000 UTC m=+2.027473464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:39.551476 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.551454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7fkr\" (UniqueName: \"kubernetes.io/projected/804f28ca-7cf6-4c34-9dda-1606099c9140-kube-api-access-s7fkr\") pod \"tuned-nprj5\" (UID: \"804f28ca-7cf6-4c34-9dda-1606099c9140\") " pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.553615 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.553593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c5qg\" (UniqueName: \"kubernetes.io/projected/40aed566-4224-4280-a5b1-b13adfda62de-kube-api-access-2c5qg\") pod \"node-resolver-vbphz\" (UID: \"40aed566-4224-4280-a5b1-b13adfda62de\") " pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.637282 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-system-cni-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-hostroot\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-hostroot\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-system-cni-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-etc-kubernetes\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-ovn\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-env-overrides\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637434 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-etc-kubernetes\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-systemd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cnibin\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-cnibin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-systemd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-ovn\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-var-lib-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637510 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cnibin\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-cnibin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-socket-dir-parent\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-var-lib-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-netns\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-multus-certs\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637603 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-socket-dir-parent\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-netns\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.637799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-multus-certs\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.637683 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-multus\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.637730 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.137716938 +0000 UTC m=+2.114672592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-multus\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-slash\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctrz\" (UniqueName: \"kubernetes.io/projected/df15ac63-af5f-438e-b960-dc42622b9864-kube-api-access-mctrz\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64zs\" (UniqueName: \"kubernetes.io/projected/e32fa497-fc6c-47eb-8b1e-be23da06da64-kube-api-access-p64zs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94273d18-2c00-461d-bec8-c84507ac7cc0-agent-certs\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-kubelet\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637872 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-slash\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637947 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-env-overrides\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-kubelet\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.637993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-node-log\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.638621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df15ac63-af5f-438e-b960-dc42622b9864-ovn-node-metrics-cert\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-os-release\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638068 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638070 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-node-log\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-os-release\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bw8f\" (UniqueName: \"kubernetes.io/projected/3ea8f168-41d5-4192-9196-4ccab6ff022d-kube-api-access-7bw8f\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-os-release\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638188 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0482ee12-b8a6-451a-9cbb-c70fc7435a62-host\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0482ee12-b8a6-451a-9cbb-c70fc7435a62-host\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-conf-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638289 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-run-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-bin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-conf-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv9h2\" (UniqueName: \"kubernetes.io/projected/ce3db5f5-7012-41e6-85cb-f2afb8af4224-kube-api-access-kv9h2\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638357 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-var-lib-cni-bin\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.639461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-device-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-device-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-os-release\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-sys-fs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-kubelet\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-netns\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94273d18-2c00-461d-bec8-c84507ac7cc0-konnectivity-ca\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-sys-fs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-cni-binary-copy\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-daemon-config\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-kubelet\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-run-netns\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0482ee12-b8a6-451a-9cbb-c70fc7435a62-serviceca\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-bin\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-socket-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-script-lib\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-binary-copy\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638804 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-bin\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-netd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-config\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-system-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-k8s-cni-cncf-io\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-registration-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzhxk\" (UniqueName: \"kubernetes.io/projected/0482ee12-b8a6-451a-9cbb-c70fc7435a62-kube-api-access-fzhxk\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-dbus\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szr5\" (UniqueName: \"kubernetes.io/projected/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-kube-api-access-4szr5\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-log-socket\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-systemd-units\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-etc-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0482ee12-b8a6-451a-9cbb-c70fc7435a62-serviceca\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.640737 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-kubelet-config\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639239 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94273d18-2c00-461d-bec8-c84507ac7cc0-konnectivity-ca\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-multus-daemon-config\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea8f168-41d5-4192-9196-4ccab6ff022d-cni-binary-copy\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.638584 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-socket-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-kubelet-config\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639326 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639348 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-binary-copy\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639357 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639392 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-log-socket\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c04944a-8044-4688-84cc-cf5a2fc6807e-dbus\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-systemd-units\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-etc-openvswitch\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.639514 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:39.639581 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:54:40.13956317 +0000 UTC m=+2.116518838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:39.641227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-system-cni-dir\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639610 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df15ac63-af5f-438e-b960-dc42622b9864-host-cni-netd\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea8f168-41d5-4192-9196-4ccab6ff022d-host-run-k8s-cni-cncf-io\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e32fa497-fc6c-47eb-8b1e-be23da06da64-registration-dir\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-script-lib\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.639781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df15ac63-af5f-438e-b960-dc42622b9864-ovnkube-config\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.640587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94273d18-2c00-461d-bec8-c84507ac7cc0-agent-certs\") pod \"konnectivity-agent-5887v\" (UID: \"94273d18-2c00-461d-bec8-c84507ac7cc0\") " pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.641696 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.641436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df15ac63-af5f-438e-b960-dc42622b9864-ovn-node-metrics-cert\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.647593 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.647571 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctrz\" (UniqueName: \"kubernetes.io/projected/df15ac63-af5f-438e-b960-dc42622b9864-kube-api-access-mctrz\") pod \"ovnkube-node-vgjbk\" (UID: \"df15ac63-af5f-438e-b960-dc42622b9864\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.647714 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.647698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv9h2\" (UniqueName: \"kubernetes.io/projected/ce3db5f5-7012-41e6-85cb-f2afb8af4224-kube-api-access-kv9h2\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:39.650270 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.650245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bw8f\" (UniqueName: \"kubernetes.io/projected/3ea8f168-41d5-4192-9196-4ccab6ff022d-kube-api-access-7bw8f\") pod \"multus-qdqxx\" (UID: \"3ea8f168-41d5-4192-9196-4ccab6ff022d\") " pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.650377 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.650308 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzhxk\" (UniqueName: \"kubernetes.io/projected/0482ee12-b8a6-451a-9cbb-c70fc7435a62-kube-api-access-fzhxk\") pod \"node-ca-22qsf\" (UID: \"0482ee12-b8a6-451a-9cbb-c70fc7435a62\") " pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.650571 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.650552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64zs\" (UniqueName: \"kubernetes.io/projected/e32fa497-fc6c-47eb-8b1e-be23da06da64-kube-api-access-p64zs\") pod \"aws-ebs-csi-driver-node-jclfl\" (UID: \"e32fa497-fc6c-47eb-8b1e-be23da06da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.651038 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.651020 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szr5\" (UniqueName: \"kubernetes.io/projected/a4fa2709-61eb-49fe-a1a6-bc11c30d6bde-kube-api-access-4szr5\") pod \"multus-additional-cni-plugins-tr5qv\" (UID: \"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde\") " pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.759306 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.759208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrdk5" Jun 11 16:54:39.767475 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.767433 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71b47b9_9fc9_48cc_9592_3d39926c5f6b.slice/crio-f70e877289f176a9064156e077216eb301e788b04c3360c805f0e3acb8c3e1db WatchSource:0}: Error finding container f70e877289f176a9064156e077216eb301e788b04c3360c805f0e3acb8c3e1db: Status 404 returned error can't find the container with id f70e877289f176a9064156e077216eb301e788b04c3360c805f0e3acb8c3e1db Jun 11 16:54:39.772608 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.772588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nprj5" Jun 11 16:54:39.778815 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.778789 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804f28ca_7cf6_4c34_9dda_1606099c9140.slice/crio-72934a87872a6bc7476f710b86a3fa7fceb6b098681a81e800d98b546fd25a46 WatchSource:0}: Error finding container 72934a87872a6bc7476f710b86a3fa7fceb6b098681a81e800d98b546fd25a46: Status 404 returned error can't find the container with id 72934a87872a6bc7476f710b86a3fa7fceb6b098681a81e800d98b546fd25a46 Jun 11 16:54:39.779425 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.779411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vbphz" Jun 11 16:54:39.785125 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.785105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22qsf" Jun 11 16:54:39.787109 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.787084 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40aed566_4224_4280_a5b1_b13adfda62de.slice/crio-cc2c43d62b90c8625fa03027eb0b2a9bdab1d27da1e6c8cb0a8d4b7de2167d6b WatchSource:0}: Error finding container cc2c43d62b90c8625fa03027eb0b2a9bdab1d27da1e6c8cb0a8d4b7de2167d6b: Status 404 returned error can't find the container with id cc2c43d62b90c8625fa03027eb0b2a9bdab1d27da1e6c8cb0a8d4b7de2167d6b Jun 11 16:54:39.788658 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.788626 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qdqxx" Jun 11 16:54:39.792709 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.792684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0482ee12_b8a6_451a_9cbb_c70fc7435a62.slice/crio-39482481ce8b76d95d66b76b543a674340decd80b88a5552abea7d5572c61c0e WatchSource:0}: Error finding container 39482481ce8b76d95d66b76b543a674340decd80b88a5552abea7d5572c61c0e: Status 404 returned error can't find the container with id 39482481ce8b76d95d66b76b543a674340decd80b88a5552abea7d5572c61c0e Jun 11 16:54:39.794259 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.794243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:54:39.797721 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.797698 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea8f168_41d5_4192_9196_4ccab6ff022d.slice/crio-52d3ed4f954cf3e33c23daee5c8cab3f9a6f32d0f3b744b32047055e9681e0dd WatchSource:0}: Error finding container 52d3ed4f954cf3e33c23daee5c8cab3f9a6f32d0f3b744b32047055e9681e0dd: Status 404 returned error can't find the container with id 52d3ed4f954cf3e33c23daee5c8cab3f9a6f32d0f3b744b32047055e9681e0dd Jun 11 16:54:39.801032 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.800993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:54:39.802093 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.802074 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf15ac63_af5f_438e_b960_dc42622b9864.slice/crio-5a04bf044734592b95e0c38175ca1b0563d3851dd34e533d1598fd8f9b7f12de WatchSource:0}: Error finding container 5a04bf044734592b95e0c38175ca1b0563d3851dd34e533d1598fd8f9b7f12de: Status 404 returned error can't find the container with id 5a04bf044734592b95e0c38175ca1b0563d3851dd34e533d1598fd8f9b7f12de Jun 11 16:54:39.806327 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.806309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" Jun 11 16:54:39.809222 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.809198 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94273d18_2c00_461d_bec8_c84507ac7cc0.slice/crio-78cc1e2e5aff0e3e71f2d4d5d83b5b9c2fa291ecf92ffe9c19b0b58db4dbfb90 WatchSource:0}: Error finding container 78cc1e2e5aff0e3e71f2d4d5d83b5b9c2fa291ecf92ffe9c19b0b58db4dbfb90: Status 404 returned error can't find the container with id 78cc1e2e5aff0e3e71f2d4d5d83b5b9c2fa291ecf92ffe9c19b0b58db4dbfb90 Jun 11 16:54:39.810396 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:39.810352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" Jun 11 16:54:39.816952 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.816931 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fa2709_61eb_49fe_a1a6_bc11c30d6bde.slice/crio-6e5e17eec91cd4ae35185fd6f9990b70257de883fb020269d471af602c58fe6c WatchSource:0}: Error finding container 6e5e17eec91cd4ae35185fd6f9990b70257de883fb020269d471af602c58fe6c: Status 404 returned error can't find the container with id 6e5e17eec91cd4ae35185fd6f9990b70257de883fb020269d471af602c58fe6c Jun 11 16:54:39.818689 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:54:39.818634 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32fa497_fc6c_47eb_8b1e_be23da06da64.slice/crio-ebd4fe787fcc444148f1728ca7f23df2eee5341ca447e822dbadbf2f114e14a8 WatchSource:0}: Error finding container ebd4fe787fcc444148f1728ca7f23df2eee5341ca447e822dbadbf2f114e14a8: Status 404 returned error can't find the container with id ebd4fe787fcc444148f1728ca7f23df2eee5341ca447e822dbadbf2f114e14a8 Jun 11 16:54:40.143536 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.143460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:40.143536 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.143516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:40.143746 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.143547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:40.143746 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.143680 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:40.143746 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.143738 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:41.143719424 +0000 UTC m=+3.120675081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:40.144174 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144157 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:40.144273 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:54:41.1441967 +0000 UTC m=+3.121152371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:40.144337 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144296 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:40.144337 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144314 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:40.144434 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144347 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:40.144434 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.144386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:41.144373848 +0000 UTC m=+3.121329521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:40.300838 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.300808 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:40.490340 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.490274 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:49:39 +0000 UTC" deadline="2028-01-06 06:22:32.316386957 +0000 UTC" Jun 11 16:54:40.490340 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.490339 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13765h27m51.826053127s" Jun 11 16:54:40.504111 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.504082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:40.504293 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:40.504215 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:40.526959 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.525178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"5a04bf044734592b95e0c38175ca1b0563d3851dd34e533d1598fd8f9b7f12de"} Jun 11 16:54:40.543549 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.543441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qdqxx" event={"ID":"3ea8f168-41d5-4192-9196-4ccab6ff022d","Type":"ContainerStarted","Data":"52d3ed4f954cf3e33c23daee5c8cab3f9a6f32d0f3b744b32047055e9681e0dd"} Jun 11 16:54:40.548429 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.548393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22qsf" event={"ID":"0482ee12-b8a6-451a-9cbb-c70fc7435a62","Type":"ContainerStarted","Data":"39482481ce8b76d95d66b76b543a674340decd80b88a5552abea7d5572c61c0e"} Jun 11 16:54:40.556334 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.556296 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nprj5" event={"ID":"804f28ca-7cf6-4c34-9dda-1606099c9140","Type":"ContainerStarted","Data":"72934a87872a6bc7476f710b86a3fa7fceb6b098681a81e800d98b546fd25a46"} Jun 11 16:54:40.576303 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.576254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrdk5" event={"ID":"a71b47b9-9fc9-48cc-9592-3d39926c5f6b","Type":"ContainerStarted","Data":"f70e877289f176a9064156e077216eb301e788b04c3360c805f0e3acb8c3e1db"} Jun 11 16:54:40.594542 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.594414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" event={"ID":"e32fa497-fc6c-47eb-8b1e-be23da06da64","Type":"ContainerStarted","Data":"ebd4fe787fcc444148f1728ca7f23df2eee5341ca447e822dbadbf2f114e14a8"} Jun 11 16:54:40.612513 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.612467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerStarted","Data":"6e5e17eec91cd4ae35185fd6f9990b70257de883fb020269d471af602c58fe6c"} Jun 11 16:54:40.620519 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.620473 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5887v" event={"ID":"94273d18-2c00-461d-bec8-c84507ac7cc0","Type":"ContainerStarted","Data":"78cc1e2e5aff0e3e71f2d4d5d83b5b9c2fa291ecf92ffe9c19b0b58db4dbfb90"} Jun 11 16:54:40.633409 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.633370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vbphz" event={"ID":"40aed566-4224-4280-a5b1-b13adfda62de","Type":"ContainerStarted","Data":"cc2c43d62b90c8625fa03027eb0b2a9bdab1d27da1e6c8cb0a8d4b7de2167d6b"} Jun 11 16:54:40.740375 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:40.740290 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:41.160213 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.160131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:41.160213 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.160188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:41.160499 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.160226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:41.160499 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160351 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:41.160499 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160411 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:43.160391764 +0000 UTC m=+5.137347455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:41.160838 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160813 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:41.161032 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160871 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:54:43.160854282 +0000 UTC m=+5.137809941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:41.161032 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160973 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:41.161032 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.160987 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:41.161032 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.161000 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:41.161247 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.161037 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:43.161024743 +0000 UTC m=+5.137980412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:41.491491 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.491369 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:49:39 +0000 UTC" deadline="2027-12-03 05:00:14.669516786 +0000 UTC" Jun 11 16:54:41.491491 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.491412 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12948h5m33.178109715s" Jun 11 16:54:41.503554 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.503180 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:41.504606 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.503880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:41.504606 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:41.504016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:41.504606 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.504134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:41.505038 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:41.504993 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:42.078601 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:42.078566 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:54:42.503177 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:42.503097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:42.503621 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:42.503245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:43.177571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:43.177629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:43.177662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177785 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177845 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:47.177828607 +0000 UTC m=+9.154784283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177853 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177869 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177881 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177785 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:47.177904735 +0000 UTC m=+9.154875621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:43.178064 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.177963 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:54:47.177942132 +0000 UTC m=+9.154897787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:43.501342 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:43.501253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:43.501342 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:43.501290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:43.501548 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.501394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:43.501548 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:43.501524 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:44.501428 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:44.501341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:44.501870 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:44.501473 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:45.502448 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:45.501727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:45.502448 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:45.501849 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:45.502448 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:45.502255 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:45.502448 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:45.502411 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:46.501807 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:46.501523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:46.501807 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:46.501660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:47.215899 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:47.215700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:47.215899 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:47.215755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:47.215899 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:47.215822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:47.215899 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.215894 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.215935 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.215939 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.215949 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.216000 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:54:55.215982976 +0000 UTC m=+17.192938634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.216018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:55.216009422 +0000 UTC m=+17.192965082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.216048 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:47.216561 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.216090 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:54:55.216073274 +0000 UTC m=+17.193028944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:47.502138 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:47.502031 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:47.502138 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:47.502079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:47.502364 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.502172 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:47.502364 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:47.502274 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:48.503520 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:48.502594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:48.503520 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:48.502708 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:49.501216 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:49.501127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:49.501392 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:49.501264 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:49.501392 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:49.501318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:49.501509 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:49.501445 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:50.501104 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:50.501074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:50.501576 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:50.501194 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:51.500958 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:51.500934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:51.501038 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:51.500974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:51.501071 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:51.501050 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:51.501161 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:51.501142 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:52.502054 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:52.502018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:52.502488 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:52.502150 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:53.501495 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:53.501451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:53.501669 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:53.501573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:53.501669 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:53.501614 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:53.501786 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:53.501685 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:54.502100 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:54.502063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:54.502554 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:54.502189 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:55.276630 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:55.276598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:55.276647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276747 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276766 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276782 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:55.276788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276795 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:55.276845 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276807 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:55:11.276791698 +0000 UTC m=+33.253747356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:54:55.277167 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.276853 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:11.276837749 +0000 UTC m=+33.253793425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:54:55.277365 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.277349 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:55.277437 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.277401 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:11.277387326 +0000 UTC m=+33.254342984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:54:55.507461 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:55.507415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:55.507890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:55.507464 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:55.507890 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.507551 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:55.507890 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:55.507689 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:56.501409 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:56.501375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:56.501568 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:56.501519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:57.501690 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:57.501661 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:57.502190 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:57.501671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:57.502190 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:57.501772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:54:57.502190 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:57.501867 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:58.504465 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:58.503810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:54:58.504465 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:58.504406 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:54:59.501603 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:59.501568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:54:59.501859 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:54:59.501568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:54:59.501859 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:59.501681 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:54:59.501859 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:54:59.501761 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:00.501928 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.501876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:00.502405 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:00.502055 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:00.678098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.677921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"1bc32daf3b549d068077ced5ef5878fd402cf6f63fa257d6bfb75a019d4e9a42"} Jun 11 16:55:00.678702 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.678192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"1ba039a87d4a5f89920fa2e6b1298f0e468f30a29d16b24dd8675fea1d568091"} Jun 11 16:55:00.679828 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.679805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qdqxx" event={"ID":"3ea8f168-41d5-4192-9196-4ccab6ff022d","Type":"ContainerStarted","Data":"7e6dbf5fae152593ff9de114852dc730e21862d53798a69ace20d8cef6b52e33"} Jun 11 16:55:00.681138 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.681118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nprj5" event={"ID":"804f28ca-7cf6-4c34-9dda-1606099c9140","Type":"ContainerStarted","Data":"4a72d208b3b1d74c9249da6245c3b4515e7e414d73e047e882bcb2b0bc21a8e6"} Jun 11 16:55:00.683052 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.683033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" event={"ID":"48789ea73209d8607b1fc3fcf49c9cc9","Type":"ContainerStarted","Data":"5c5411ac196a01703503265f9b78957cb1afa6b05ebc66d02335f1fdb7fcd2bd"} Jun 11 16:55:00.716621 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.716554 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nprj5" podStartSLOduration=2.677913363 podStartE2EDuration="22.716534909s" totalImagesPullingTime="20.038621546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:00.71462053 +0000 UTC m=+22.691576210" watchObservedRunningTime="2026-06-11 16:55:00.716534909 +0000 UTC m=+22.693490589" Jun 11 16:55:00.793702 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:00.793652 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-82.ec2.internal" podStartSLOduration=21.793636298 podStartE2EDuration="21.793636298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:00.752687713 +0000 UTC m=+22.729643391" watchObservedRunningTime="2026-06-11 16:55:00.793636298 +0000 UTC m=+22.770591975" Jun 11 16:55:01.501544 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.501295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:01.501771 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.501344 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:01.501771 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:01.501593 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:01.501771 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:01.501697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:01.686517 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.686479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5887v" event={"ID":"94273d18-2c00-461d-bec8-c84507ac7cc0","Type":"ContainerStarted","Data":"99eab0505d6cd1e38ebb56c8cf172b240aa4aaebd7c84ae14e7138ed1d0b9994"} Jun 11 16:55:01.688316 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.688291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vbphz" event={"ID":"40aed566-4224-4280-a5b1-b13adfda62de","Type":"ContainerStarted","Data":"210726629ce1e0a5cb1779705f53b69abb1a22fa0093016231aeb2ddbb2ce17f"} Jun 11 16:55:01.689679 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.689657 2579 generic.go:356] "Generic (PLEG): container finished" podID="859aedd1a2f15ceb391480181fea78bc" containerID="7d424c5e826df71e544698ef4173fabb784c4898d2594fc629544552c7a0f2ff" exitCode=0 Jun 11 16:55:01.689766 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.689728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" event={"ID":"859aedd1a2f15ceb391480181fea78bc","Type":"ContainerDied","Data":"7d424c5e826df71e544698ef4173fabb784c4898d2594fc629544552c7a0f2ff"} Jun 11 16:55:01.692540 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.692516 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:55:01.692833 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.692813 2579 generic.go:356] "Generic (PLEG): container finished" podID="df15ac63-af5f-438e-b960-dc42622b9864" containerID="1bc32daf3b549d068077ced5ef5878fd402cf6f63fa257d6bfb75a019d4e9a42" exitCode=1 Jun 11 16:55:01.692898 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.692883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerDied","Data":"1bc32daf3b549d068077ced5ef5878fd402cf6f63fa257d6bfb75a019d4e9a42"} Jun 11 16:55:01.692974 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.692958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"1d8dd7968a7b1f28cf21be809db7f53d87292060175c526d52ffc8b475b1336f"} Jun 11 16:55:01.693016 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.693006 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"0b54cebbf037caca9a2a63d4144b046add9e215e16a5fc90425e7a079a58a828"} Jun 11 16:55:01.693054 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.693037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"5df57ee5dd67f1ab2445d8902f3913158d98ea2d245f44bba2308ccc547ac533"} Jun 11 16:55:01.693098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.693078 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"79eab0b29984a53d473f60a0f43b068494f906fa875b00c5ed69bcedba00c66d"} Jun 11 16:55:01.694128 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.694109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22qsf" event={"ID":"0482ee12-b8a6-451a-9cbb-c70fc7435a62","Type":"ContainerStarted","Data":"b897048b47124d0e9cd4c5fa0ff49d11a6170d8836b2c07bec55acc7f6f0dba1"} Jun 11 16:55:01.695489 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.695468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrdk5" event={"ID":"a71b47b9-9fc9-48cc-9592-3d39926c5f6b","Type":"ContainerStarted","Data":"9270397ef1b7e98c0987439689feaa4e03fb0b1e01cba238e9714de88bee24b9"} Jun 11 16:55:01.696810 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.696793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" event={"ID":"e32fa497-fc6c-47eb-8b1e-be23da06da64","Type":"ContainerStarted","Data":"c6ee2106c31da91fccf21090cadd4660beb33c273dc0af3c700719b7c06cb897"} Jun 11 16:55:01.698174 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.698152 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="606c490f0d558c991d40c05673ef28de070aa6074a49c3959a74842534439764" exitCode=0 Jun 11 16:55:01.698277 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.698186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"606c490f0d558c991d40c05673ef28de070aa6074a49c3959a74842534439764"} Jun 11 16:55:01.718703 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.718665 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5887v" podStartSLOduration=3.855523945 podStartE2EDuration="23.718639146s" totalImagesPullingTime="19.863115201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:01.716739255 +0000 UTC m=+23.693694943" watchObservedRunningTime="2026-06-11 16:55:01.718639146 +0000 UTC m=+23.695594823" Jun 11 16:55:01.719133 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.719103 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qdqxx" podStartSLOduration=3.683798601 podStartE2EDuration="23.719094088s" totalImagesPullingTime="20.035295487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:00.794412382 +0000 UTC m=+22.771368071" watchObservedRunningTime="2026-06-11 16:55:01.719094088 +0000 UTC m=+23.696049764" Jun 11 16:55:01.776817 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.776764 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hrdk5" podStartSLOduration=3.870247663 podStartE2EDuration="23.776744413s" totalImagesPullingTime="19.90649675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:01.747169985 +0000 UTC m=+23.724125663" watchObservedRunningTime="2026-06-11 16:55:01.776744413 +0000 UTC m=+23.753700088" Jun 11 16:55:01.809159 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.809103 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vbphz" podStartSLOduration=3.92186285 podStartE2EDuration="23.809088506s" totalImagesPullingTime="19.887225656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:01.777529509 +0000 UTC m=+23.754485185" watchObservedRunningTime="2026-06-11 16:55:01.809088506 +0000 UTC m=+23.786044183" Jun 11 16:55:01.853013 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:01.852954 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-22qsf" podStartSLOduration=3.971942514 podStartE2EDuration="23.85293136s" totalImagesPullingTime="19.880988846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:01.809228673 +0000 UTC m=+23.786184358" watchObservedRunningTime="2026-06-11 16:55:01.85293136 +0000 UTC m=+23.829887033" Jun 11 16:55:02.026541 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.026098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:02.228426 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.228383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:02.308495 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.308472 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:55:02.346521 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.346491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:02.499023 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.498898 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:55:02.30848902Z","UUID":"852ab96c-5b34-41a3-8981-baf492395c5f","Handler":null,"Name":"","Endpoint":""} Jun 11 16:55:02.500511 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.500491 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:55:02.500652 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.500536 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:55:02.501323 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.501159 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:02.501323 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:02.501284 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:02.702736 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.702651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" event={"ID":"859aedd1a2f15ceb391480181fea78bc","Type":"ContainerStarted","Data":"aff94286fdaa53efea25e7bc705cd19a1e4f7dfa491be95ff1be96bdded80c3a"} Jun 11 16:55:02.704524 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.704453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" event={"ID":"e32fa497-fc6c-47eb-8b1e-be23da06da64","Type":"ContainerStarted","Data":"a58aba35630a38b97cd7c20abe515b160f72371c91b271623c6ca923a590fc13"} Jun 11 16:55:02.721578 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:02.721533 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-82.ec2.internal" podStartSLOduration=23.721516148 podStartE2EDuration="23.721516148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:02.721001261 +0000 UTC m=+24.697956938" watchObservedRunningTime="2026-06-11 16:55:02.721516148 +0000 UTC m=+24.698471827" Jun 11 16:55:03.073447 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.073352 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:55:03.074239 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.074215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:55:03.183170 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.183125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:03.316493 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.316465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:03.501318 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.501286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:03.501492 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.501288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:03.501492 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:03.501399 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:03.501631 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:03.501501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:03.713122 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.713090 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:55:03.713602 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.713565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"8b89296f39633839e187737b9bc7ce4a06c9d1dd34dac6c3580b72cc5924dc49"} Jun 11 16:55:03.715958 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.715867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" event={"ID":"e32fa497-fc6c-47eb-8b1e-be23da06da64","Type":"ContainerStarted","Data":"2d35a52debe49a4d03428f71cd1cc84dd6011bc23bf100a9d687e06b3f0439ac"} Jun 11 16:55:03.781191 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:03.781139 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jclfl" podStartSLOduration=3.422426988 podStartE2EDuration="25.781121437s" totalImagesPullingTime="22.358694449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:03.78083137 +0000 UTC m=+25.757787047" watchObservedRunningTime="2026-06-11 16:55:03.781121437 +0000 UTC m=+25.758077114" Jun 11 16:55:04.007446 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.007409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.229143 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.228858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.436283 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.436245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.505109 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.505032 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:04.505258 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.505037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:04.505258 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:04.505137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:04.505258 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:04.505202 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:04.718058 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.718024 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 16:55:04.834614 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.834459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.977726 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:04.977678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:05.032829 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:05.032801 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:55:05.033413 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:05.033395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5887v" Jun 11 16:55:05.159731 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:05.159642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:05.501539 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:05.501461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:05.501702 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:05.501595 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:06.417484 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.417217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:06.501767 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.501734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:06.502003 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.501732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:06.502003 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:06.501841 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:06.502003 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:06.501965 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:06.725630 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.725551 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:55:06.725955 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.725923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"20320d5f373ed75e6e897331223000877f5eba499a8fdd7ed5fc26857eda5242"} Jun 11 16:55:06.726158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.726139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:06.726385 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.726367 2579 scope.go:117] "RemoveContainer" containerID="1bc32daf3b549d068077ced5ef5878fd402cf6f63fa257d6bfb75a019d4e9a42" Jun 11 16:55:06.727981 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.727961 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="642bc4168e9755dc51a0440f5f11dd24faef46ab3d7b032670f77ecae3a3f119" exitCode=0 Jun 11 16:55:06.728069 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.728050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"642bc4168e9755dc51a0440f5f11dd24faef46ab3d7b032670f77ecae3a3f119"} Jun 11 16:55:06.743208 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:06.743182 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:07.501803 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.501774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:07.502244 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:07.501892 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:07.733774 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.733745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:55:07.734132 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.734107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" event={"ID":"df15ac63-af5f-438e-b960-dc42622b9864","Type":"ContainerStarted","Data":"c09005066f5adf2b85eb2825df589b1559a29ea0552d66817ee81357b7981aa0"} Jun 11 16:55:07.734386 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.734365 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:07.734452 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.734445 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:07.749861 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.749833 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:07.769790 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:07.769743 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" podStartSLOduration=9.155498915 podStartE2EDuration="29.769728169s" totalImagesPullingTime="20.614229254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:07.767930028 +0000 UTC m=+29.744885721" watchObservedRunningTime="2026-06-11 16:55:07.769728169 +0000 UTC m=+29.746683846" Jun 11 16:55:08.136119 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.136042 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fj4ck"] Jun 11 16:55:08.136275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.136263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:08.136372 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:08.136353 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:08.139980 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.139950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tdtjg"] Jun 11 16:55:08.140118 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.140062 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:08.140175 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:08.140150 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:08.140700 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.140672 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gq2cz"] Jun 11 16:55:08.140823 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.140792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:08.140936 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:08.140900 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:08.738320 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.738281 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="7e9c2f88f813129ef2b3dab3fb5adc012d6791ad8f9eb1598ac958ad880c066e" exitCode=0 Jun 11 16:55:08.738786 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:08.738363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"7e9c2f88f813129ef2b3dab3fb5adc012d6791ad8f9eb1598ac958ad880c066e"} Jun 11 16:55:09.501108 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:09.501084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:09.501233 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:09.501093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:09.501233 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:09.501186 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:09.501345 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:09.501279 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:09.501345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:09.501093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:09.501444 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:09.501422 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:10.745023 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:10.744986 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="3a96d7874b4505bd72831a1f93a81961a7140508d88dc98e403b54b8437a251a" exitCode=0 Jun 11 16:55:10.745626 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:10.745029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"3a96d7874b4505bd72831a1f93a81961a7140508d88dc98e403b54b8437a251a"} Jun 11 16:55:11.306272 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.306227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:11.306452 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.306317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:11.306452 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306366 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:55:11.306452 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306442 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret podName:7c04944a-8044-4688-84cc-cf5a2fc6807e nodeName:}" failed. No retries permitted until 2026-06-11 16:55:43.3064213 +0000 UTC m=+65.283376969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret") pod "global-pull-secret-syncer-fj4ck" (UID: "7c04944a-8044-4688-84cc-cf5a2fc6807e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:55:11.306452 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306446 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306463 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306482 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306492 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b9wjx for pod openshift-network-diagnostics/network-check-target-tdtjg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:43.306482584 +0000 UTC m=+65.283438241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.306350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:11.306687 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.306524 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx podName:a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4 nodeName:}" failed. No retries permitted until 2026-06-11 16:55:43.306513315 +0000 UTC m=+65.283468971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9wjx" (UniqueName: "kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx") pod "network-check-target-tdtjg" (UID: "a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:55:11.501442 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.501407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:11.501442 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.501439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:11.501673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:11.501439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:11.501673 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.501530 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:11.501673 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.501636 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:11.501836 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:11.501744 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:13.501478 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.501418 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:13.501478 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.501451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:13.502152 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.501543 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fj4ck" podUID="7c04944a-8044-4688-84cc-cf5a2fc6807e" Jun 11 16:55:13.502152 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.501596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:13.502152 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.501692 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:55:13.502152 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.501765 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tdtjg" podUID="a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4" Jun 11 16:55:13.873636 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.873544 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-82.ec2.internal" event="NodeReady" Jun 11 16:55:13.873904 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.873695 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:55:13.965554 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.965523 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8jx4f"] Jun 11 16:55:13.970629 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.970598 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hmlsv"] Jun 11 16:55:13.970770 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.970752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:13.974285 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.974213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:13.981672 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.981526 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-default-8jx4f\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="c898b89f-feaf-41d1-8310-cd479dbef86f" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:13.981672 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.981536 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-dockercfg-x9gb4\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9gb4\"" type="*v1.Secret" Jun 11 16:55:13.981672 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.981536 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" Jun 11 16:55:13.981860 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.981711 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-default\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" Jun 11 16:55:13.983746 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.983722 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 11 16:55:13.984656 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.984616 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 11 16:55:13.987326 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.987302 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vd977\"" Jun 11 16:55:13.989540 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:13.989519 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:55:13.989782 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:13.989743 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-default-8jx4f\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="c898b89f-feaf-41d1-8310-cd479dbef86f" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.005774 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.005744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmlsv"] Jun 11 16:55:14.042742 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.042651 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jx4f"] Jun 11 16:55:14.126157 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgdp\" (UniqueName: \"kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:14.126157 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.126372 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-cert\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:14.126372 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.126372 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmcl\" (UniqueName: \"kubernetes.io/projected/c898b89f-feaf-41d1-8310-cd479dbef86f-kube-api-access-zrmcl\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.126372 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.126354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c898b89f-feaf-41d1-8310-cd479dbef86f-tmp-dir\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.227311 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgdp\" (UniqueName: \"kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:14.227311 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.227569 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-cert\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:14.227569 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.227569 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmcl\" (UniqueName: \"kubernetes.io/projected/c898b89f-feaf-41d1-8310-cd479dbef86f-kube-api-access-zrmcl\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.227569 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c898b89f-feaf-41d1-8310-cd479dbef86f-tmp-dir\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.227799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.227779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c898b89f-feaf-41d1-8310-cd479dbef86f-tmp-dir\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.231967 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.231944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-cert\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:14.236888 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.236861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmcl\" (UniqueName: \"kubernetes.io/projected/c898b89f-feaf-41d1-8310-cd479dbef86f-kube-api-access-zrmcl\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:14.274757 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.274720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:14.363636 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:14.363591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:15.044442 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.044297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9gb4\"" Jun 11 16:55:15.117149 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.117123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:55:15.118150 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.118137 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:15.118202 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.118197 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:15.618178145 +0000 UTC m=+37.595133799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:15.228444 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.228408 2579 configmap.go:193] Couldn't get configMap openshift-dns/dns-default: failed to sync configmap cache: timed out waiting for the condition Jun 11 16:55:15.228589 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.228501 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:15.728483838 +0000 UTC m=+37.705439510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : failed to sync configmap cache: timed out waiting for the condition Jun 11 16:55:15.234998 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.234971 2579 projected.go:291] Couldn't get configMap openshift-ingress-canary/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 11 16:55:15.328414 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.328381 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:55:15.336013 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.335991 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9mgdp for pod openshift-ingress-canary/ingress-canary-hmlsv: failed to sync configmap cache: timed out waiting for the condition Jun 11 16:55:15.336098 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.336054 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp podName:662e86eb-499b-4a2f-bfb0-23bf36c01f7d nodeName:}" failed. No retries permitted until 2026-06-11 16:55:15.836037664 +0000 UTC m=+37.812993336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9mgdp" (UniqueName: "kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp") pod "ingress-canary-hmlsv" (UID: "662e86eb-499b-4a2f-bfb0-23bf36c01f7d") : failed to sync configmap cache: timed out waiting for the condition Jun 11 16:55:15.370838 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.370811 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:55:15.501149 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.501114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:15.501149 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.501138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:15.501340 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.501124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:15.504965 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.504947 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:55:15.505089 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.504947 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:55:15.505521 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.505506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mzdmg\"" Jun 11 16:55:15.505582 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.505514 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:55:15.505582 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.505527 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:55:15.505582 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.505506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxj6x\"" Jun 11 16:55:15.509203 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.509183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:55:15.640545 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.640451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:15.640721 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.640601 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:15.640721 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:15.640669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:16.640655922 +0000 UTC m=+38.617611576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:15.741154 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.741119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:15.741709 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.741681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c898b89f-feaf-41d1-8310-cd479dbef86f-config-volume\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:15.759320 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.759288 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="bc3ea5bc4684bb00d65edb666820cd32d261ad79071aa7ee6b35375a63d724f0" exitCode=0 Jun 11 16:55:15.759493 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.759341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"bc3ea5bc4684bb00d65edb666820cd32d261ad79071aa7ee6b35375a63d724f0"} Jun 11 16:55:15.842263 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.842236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgdp\" (UniqueName: \"kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:15.845448 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:15.845419 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgdp\" (UniqueName: \"kubernetes.io/projected/662e86eb-499b-4a2f-bfb0-23bf36c01f7d-kube-api-access-9mgdp\") pod \"ingress-canary-hmlsv\" (UID: \"662e86eb-499b-4a2f-bfb0-23bf36c01f7d\") " pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:16.090242 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.090202 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmlsv" Jun 11 16:55:16.244284 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.244251 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmlsv"] Jun 11 16:55:16.249028 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:55:16.249000 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662e86eb_499b_4a2f_bfb0_23bf36c01f7d.slice/crio-952653e58e9b0da844fb060b5384b90e87a35eb7319fa88e8876ce140e8f6879 WatchSource:0}: Error finding container 952653e58e9b0da844fb060b5384b90e87a35eb7319fa88e8876ce140e8f6879: Status 404 returned error can't find the container with id 952653e58e9b0da844fb060b5384b90e87a35eb7319fa88e8876ce140e8f6879 Jun 11 16:55:16.648795 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.648760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:16.649009 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:16.648893 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:16.649009 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:16.648965 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:18.648949135 +0000 UTC m=+40.625904789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:16.765933 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.765876 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4fa2709-61eb-49fe-a1a6-bc11c30d6bde" containerID="7d1383ff940bebdf3161d9caac6edccfc9e934c3e5b795a1f767248c742ec5f1" exitCode=0 Jun 11 16:55:16.766220 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.766005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerDied","Data":"7d1383ff940bebdf3161d9caac6edccfc9e934c3e5b795a1f767248c742ec5f1"} Jun 11 16:55:16.767413 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:16.767390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmlsv" event={"ID":"662e86eb-499b-4a2f-bfb0-23bf36c01f7d","Type":"ContainerStarted","Data":"952653e58e9b0da844fb060b5384b90e87a35eb7319fa88e8876ce140e8f6879"} Jun 11 16:55:17.145793 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.145577 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:17.755732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.755701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:17.773207 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.773170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" event={"ID":"a4fa2709-61eb-49fe-a1a6-bc11c30d6bde","Type":"ContainerStarted","Data":"da351f812a3e7ee87cc4d966b1c8a12dba5381d88ca7da9a3688fdbeeb05c392"} Jun 11 16:55:17.807629 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.807533 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tr5qv" podStartSLOduration=9.432811972 podStartE2EDuration="39.807516811s" totalImagesPullingTime="30.374704839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:17.806407311 +0000 UTC m=+39.783362989" watchObservedRunningTime="2026-06-11 16:55:17.807516811 +0000 UTC m=+39.784472489" Jun 11 16:55:17.859039 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.858976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:17.957591 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:17.957552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:18.026815 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:18.026747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:18.665525 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:18.665486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:18.665994 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:18.665617 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:18.665994 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:18.665686 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:22.66566672 +0000 UTC m=+44.642622384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:19.778842 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:19.778796 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmlsv" event={"ID":"662e86eb-499b-4a2f-bfb0-23bf36c01f7d","Type":"ContainerStarted","Data":"5947e78592fee17b52e29b7bf7082913c2e544d415fc62a924044da6328925ec"} Jun 11 16:55:19.799201 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:19.799147 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hmlsv" podStartSLOduration=4.360602583 podStartE2EDuration="6.799130005s" totalImagesPullingTime="2.438527422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:19.79844173 +0000 UTC m=+41.775397407" watchObservedRunningTime="2026-06-11 16:55:19.799130005 +0000 UTC m=+41.776085684" Jun 11 16:55:19.801035 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:19.801009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:19.900236 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:19.900204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:21.274400 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:21.274365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:21.375965 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:21.375929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:22.694691 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:22.694657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:22.695193 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:22.694774 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:22.695193 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:22.694825 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:30.694812406 +0000 UTC m=+52.671768062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:23.519675 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:23.519638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:23.614371 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:23.614331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:30.750216 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:30.750164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:30.750676 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:30.750321 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:30.750676 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:30.750390 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:55:46.750372257 +0000 UTC m=+68.727327931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:39.778673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:39.778637 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgjbk" Jun 11 16:55:39.938404 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:39.938363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:40.002202 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:40.002165 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:40.747676 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:40.747645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:40.814663 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:40.814630 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:43.332717 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.332651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:43.332717 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.332724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:43.333265 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.332756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:55:43.335209 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.335184 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:55:43.335322 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.335274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:55:43.335479 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.335463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:55:43.343252 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:43.343224 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:55:43.343362 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:43.343321 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:56:47.343298527 +0000 UTC m=+129.320254186 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : secret "metrics-daemon-secret" not found Jun 11 16:55:43.345557 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.345538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:55:43.346567 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.346544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c04944a-8044-4688-84cc-cf5a2fc6807e-original-pull-secret\") pod \"global-pull-secret-syncer-fj4ck\" (UID: \"7c04944a-8044-4688-84cc-cf5a2fc6807e\") " pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:43.355721 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.355696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9wjx\" (UniqueName: \"kubernetes.io/projected/a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4-kube-api-access-b9wjx\") pod \"network-check-target-tdtjg\" (UID: \"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4\") " pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:43.413060 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.413022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mzdmg\"" Jun 11 16:55:43.421456 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.421430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fj4ck" Jun 11 16:55:43.421456 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.421441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:43.553854 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.553823 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fj4ck"] Jun 11 16:55:43.556826 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:55:43.556800 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c04944a_8044_4688_84cc_cf5a2fc6807e.slice/crio-ffe0a72e05a96f88da428d5e373f742c801bf6e9af4d8576445d701818f12d60 WatchSource:0}: Error finding container ffe0a72e05a96f88da428d5e373f742c801bf6e9af4d8576445d701818f12d60: Status 404 returned error can't find the container with id ffe0a72e05a96f88da428d5e373f742c801bf6e9af4d8576445d701818f12d60 Jun 11 16:55:43.568820 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.568792 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tdtjg"] Jun 11 16:55:43.573481 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:55:43.573446 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dace34_d2e5_4da3_b8fb_2ff8d13b09b4.slice/crio-0ee69a7203da7fa16e0367670ebaaad5056d8431a2211395db3dc5fd858482c5 WatchSource:0}: Error finding container 0ee69a7203da7fa16e0367670ebaaad5056d8431a2211395db3dc5fd858482c5: Status 404 returned error can't find the container with id 0ee69a7203da7fa16e0367670ebaaad5056d8431a2211395db3dc5fd858482c5 Jun 11 16:55:43.832979 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.832939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tdtjg" event={"ID":"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4","Type":"ContainerStarted","Data":"0ee69a7203da7fa16e0367670ebaaad5056d8431a2211395db3dc5fd858482c5"} Jun 11 16:55:43.833956 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:43.833929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fj4ck" event={"ID":"7c04944a-8044-4688-84cc-cf5a2fc6807e","Type":"ContainerStarted","Data":"ffe0a72e05a96f88da428d5e373f742c801bf6e9af4d8576445d701818f12d60"} Jun 11 16:55:46.760883 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:46.760849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:55:46.761402 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:46.760993 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:55:46.761402 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:55:46.761050 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:56:18.761035167 +0000 UTC m=+100.737990823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:55:48.847712 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:48.847674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tdtjg" event={"ID":"a1dace34-d2e5-4da3-b8fb-2ff8d13b09b4","Type":"ContainerStarted","Data":"fd43c5812212e50a5f5bad3af0cd9f3bc718b98d8be97667dc259061646873ca"} Jun 11 16:55:48.848164 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:48.847755 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:55:48.849073 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:48.849049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fj4ck" event={"ID":"7c04944a-8044-4688-84cc-cf5a2fc6807e","Type":"ContainerStarted","Data":"2da4602c76ca656e0be610171414f0bdf11fce72b2cd250c22f45c581d995533"} Jun 11 16:55:48.865237 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:55:48.865187 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tdtjg" podStartSLOduration=66.344111173 podStartE2EDuration="1m10.8651729s" totalImagesPullingTime="4.521061727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:48.864558253 +0000 UTC m=+70.841513931" watchObservedRunningTime="2026-06-11 16:55:48.8651729 +0000 UTC m=+70.842128576" Jun 11 16:56:18.773650 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:56:18.773594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:56:18.774101 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:56:18.773744 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:56:18.774101 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:56:18.773804 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:57:22.773786892 +0000 UTC m=+164.750742549 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:56:19.853263 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:56:19.853233 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tdtjg" Jun 11 16:56:19.872548 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:56:19.872498 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fj4ck" podStartSLOduration=97.32308686 podStartE2EDuration="1m41.872458982s" totalImagesPullingTime="4.549372122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:48.881177534 +0000 UTC m=+70.858133211" watchObservedRunningTime="2026-06-11 16:56:19.872458982 +0000 UTC m=+101.849414657" Jun 11 16:56:47.363859 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:56:47.363809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:56:47.364344 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:56:47.363978 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:56:47.364344 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:56:47.364052 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:49.364036599 +0000 UTC m=+251.340992255 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : secret "metrics-daemon-secret" not found Jun 11 16:57:16.984842 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:57:16.984789 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8jx4f" podUID="c898b89f-feaf-41d1-8310-cd479dbef86f" Jun 11 16:57:17.052282 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:57:17.052257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:57:18.515788 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:57:18.515746 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:57:22.804380 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:57:22.804333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:57:22.804851 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:57:22.804459 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:57:22.804851 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:57:22.804511 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls podName:c898b89f-feaf-41d1-8310-cd479dbef86f nodeName:}" failed. No retries permitted until 2026-06-11 16:59:24.804497463 +0000 UTC m=+286.781453118 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls") pod "dns-default-8jx4f" (UID: "c898b89f-feaf-41d1-8310-cd479dbef86f") : secret "dns-default-metrics-tls" not found Jun 11 16:57:33.501504 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:57:33.501416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:57:45.507619 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:57:45.507590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:54.584122 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:57:54.584086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:11.680613 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:11.680576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:31.593925 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.593867 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7"] Jun 11 16:58:31.596616 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.596599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" Jun 11 16:58:31.600046 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.600023 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6d4sv\"" Jun 11 16:58:31.609699 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.609676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7"] Jun 11 16:58:31.665392 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.665356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mq7g\" (UniqueName: \"kubernetes.io/projected/2fa5a15c-7626-41d6-9d43-01a1e8c68ce2-kube-api-access-9mq7g\") pod \"network-check-source-dbd9cf844-pw6n7\" (UID: \"2fa5a15c-7626-41d6-9d43-01a1e8c68ce2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" Jun 11 16:58:31.680516 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.680487 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5"] Jun 11 16:58:31.683259 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.683242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.687310 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.687284 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 16:58:31.687434 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.687398 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:58:31.687780 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.687763 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:58:31.688250 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.688220 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t72w7\"" Jun 11 16:58:31.688357 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.688330 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 16:58:31.688539 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.688521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv"] Jun 11 16:58:31.691346 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.691324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" Jun 11 16:58:31.692031 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.692013 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:58:31.693843 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.693825 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:58:31.693975 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.693904 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gdpww\"" Jun 11 16:58:31.694039 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.694015 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 16:58:31.694603 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.694590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.701099 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.701083 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:58:31.701380 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.701356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:58:31.701598 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.701578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:58:31.701682 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.701600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x475h\"" Jun 11 16:58:31.709264 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.709242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5"] Jun 11 16:58:31.710141 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.710119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv"] Jun 11 16:58:31.712567 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.712545 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:58:31.719121 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.719103 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:58:31.766652 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.766783 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.766783 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.766783 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6d6q\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.766890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.766890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.766890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mq7g\" (UniqueName: \"kubernetes.io/projected/2fa5a15c-7626-41d6-9d43-01a1e8c68ce2-kube-api-access-9mq7g\") pod \"network-check-source-dbd9cf844-pw6n7\" (UID: \"2fa5a15c-7626-41d6-9d43-01a1e8c68ce2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" Jun 11 16:58:31.766890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.766890 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-kube-api-access-2lfcm\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.767081 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.766921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtvqc\" (UniqueName: \"kubernetes.io/projected/15469931-c674-496c-8f28-c67e0a48f491-kube-api-access-jtvqc\") pod \"volume-data-source-validator-78dd696465-wvftv\" (UID: \"15469931-c674-496c-8f28-c67e0a48f491\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" Jun 11 16:58:31.767081 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.767047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.767146 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.767092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.767146 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.767120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.782456 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.782430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mq7g\" (UniqueName: \"kubernetes.io/projected/2fa5a15c-7626-41d6-9d43-01a1e8c68ce2-kube-api-access-9mq7g\") pod \"network-check-source-dbd9cf844-pw6n7\" (UID: \"2fa5a15c-7626-41d6-9d43-01a1e8c68ce2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" Jun 11 16:58:31.784193 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.784171 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ttqcl"] Jun 11 16:58:31.786959 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.786942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.791605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.791583 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:58:31.791707 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.791628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 16:58:31.792213 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.792193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 16:58:31.792381 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.792363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qd4pr\"" Jun 11 16:58:31.792654 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.792614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 16:58:31.799166 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.799146 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 16:58:31.807823 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.807802 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ttqcl"] Jun 11 16:58:31.867620 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.867620 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.867620 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.867620 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-config\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:31.867699 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:31.867728 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c89d9f8-4xjkg: secret "image-registry-tls" not found Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:31.867791 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls podName:c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:32.367772637 +0000 UTC m=+234.344728325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls") pod "image-registry-54c89d9f8-4xjkg" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026") : secret "image-registry-tls" not found Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7d02125-cd09-487e-9f84-e5f8f4c7d669-serving-cert\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6d6q\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-trusted-ca\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.867954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bc85\" (UniqueName: \"kubernetes.io/projected/e7d02125-cd09-487e-9f84-e5f8f4c7d669-kube-api-access-5bc85\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-kube-api-access-2lfcm\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtvqc\" (UniqueName: \"kubernetes.io/projected/15469931-c674-496c-8f28-c67e0a48f491-kube-api-access-jtvqc\") pod \"volume-data-source-validator-78dd696465-wvftv\" (UID: \"15469931-c674-496c-8f28-c67e0a48f491\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868108 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:31.868363 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:31.868446 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:58:32.368428805 +0000 UTC m=+234.345384474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.868649 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.869016 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.868712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.870178 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.870159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.870242 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.870191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.876940 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.876895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.877112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.877091 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-kube-api-access-2lfcm\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:31.879548 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.879527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6d6q\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:31.879637 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.879575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtvqc\" (UniqueName: \"kubernetes.io/projected/15469931-c674-496c-8f28-c67e0a48f491-kube-api-access-jtvqc\") pod \"volume-data-source-validator-78dd696465-wvftv\" (UID: \"15469931-c674-496c-8f28-c67e0a48f491\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" Jun 11 16:58:31.904542 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.904514 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" Jun 11 16:58:31.955510 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.955480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:31.969181 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.969152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7d02125-cd09-487e-9f84-e5f8f4c7d669-serving-cert\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.969364 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.969191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-trusted-ca\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.969364 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.969299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bc85\" (UniqueName: \"kubernetes.io/projected/e7d02125-cd09-487e-9f84-e5f8f4c7d669-kube-api-access-5bc85\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.969498 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.969447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-config\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.970199 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.970171 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-config\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.970345 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.970305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7d02125-cd09-487e-9f84-e5f8f4c7d669-trusted-ca\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.971269 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.971242 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7d02125-cd09-487e-9f84-e5f8f4c7d669-serving-cert\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:31.978592 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:31.978565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bc85\" (UniqueName: \"kubernetes.io/projected/e7d02125-cd09-487e-9f84-e5f8f4c7d669-kube-api-access-5bc85\") pod \"console-operator-668fdbf85c-ttqcl\" (UID: \"e7d02125-cd09-487e-9f84-e5f8f4c7d669\") " pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:32.000319 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.000291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" Jun 11 16:58:32.034167 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.034132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7"] Jun 11 16:58:32.035086 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:58:32.035055 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa5a15c_7626_41d6_9d43_01a1e8c68ce2.slice/crio-7a84f096223bbc4a4587b77e5b4d2cf222646999ca850bb5a37ce42ee5ff4b20 WatchSource:0}: Error finding container 7a84f096223bbc4a4587b77e5b4d2cf222646999ca850bb5a37ce42ee5ff4b20: Status 404 returned error can't find the container with id 7a84f096223bbc4a4587b77e5b4d2cf222646999ca850bb5a37ce42ee5ff4b20 Jun 11 16:58:32.042163 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.042129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:32.099840 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.099818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:32.145504 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.145288 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv"] Jun 11 16:58:32.150976 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:58:32.150574 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15469931_c674_496c_8f28_c67e0a48f491.slice/crio-d9ac4706f11ce324679c3a6890072c85ba05dce665efc90213a9f17f4dd03f41 WatchSource:0}: Error finding container d9ac4706f11ce324679c3a6890072c85ba05dce665efc90213a9f17f4dd03f41: Status 404 returned error can't find the container with id d9ac4706f11ce324679c3a6890072c85ba05dce665efc90213a9f17f4dd03f41 Jun 11 16:58:32.228057 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.228022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" event={"ID":"2fa5a15c-7626-41d6-9d43-01a1e8c68ce2","Type":"ContainerStarted","Data":"973d574c6f69838c429d1f4ae8b81002db7929f10c7d990194dcc3b22648a975"} Jun 11 16:58:32.228242 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.228079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" event={"ID":"2fa5a15c-7626-41d6-9d43-01a1e8c68ce2","Type":"ContainerStarted","Data":"7a84f096223bbc4a4587b77e5b4d2cf222646999ca850bb5a37ce42ee5ff4b20"} Jun 11 16:58:32.229186 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.229158 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" event={"ID":"15469931-c674-496c-8f28-c67e0a48f491","Type":"ContainerStarted","Data":"d9ac4706f11ce324679c3a6890072c85ba05dce665efc90213a9f17f4dd03f41"} Jun 11 16:58:32.237392 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.237368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ttqcl"] Jun 11 16:58:32.240123 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:58:32.240098 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d02125_cd09_487e_9f84_e5f8f4c7d669.slice/crio-c961422a4b87e711d4ad0a3e7cd6e10717cf679ab6007e49c4bfb4716bd441bd WatchSource:0}: Error finding container c961422a4b87e711d4ad0a3e7cd6e10717cf679ab6007e49c4bfb4716bd441bd: Status 404 returned error can't find the container with id c961422a4b87e711d4ad0a3e7cd6e10717cf679ab6007e49c4bfb4716bd441bd Jun 11 16:58:32.372842 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.372803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:32.373029 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:32.372849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:32.373029 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:32.372970 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:58:32.373029 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:32.372982 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c89d9f8-4xjkg: secret "image-registry-tls" not found Jun 11 16:58:32.373029 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:32.372982 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:32.373219 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:32.373040 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls podName:c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:33.373019021 +0000 UTC m=+235.349974694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls") pod "image-registry-54c89d9f8-4xjkg" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026") : secret "image-registry-tls" not found Jun 11 16:58:32.373219 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:32.373053 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:58:33.37304768 +0000 UTC m=+235.350003335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:33.233369 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:33.233337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" event={"ID":"e7d02125-cd09-487e-9f84-e5f8f4c7d669","Type":"ContainerStarted","Data":"c961422a4b87e711d4ad0a3e7cd6e10717cf679ab6007e49c4bfb4716bd441bd"} Jun 11 16:58:33.381296 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:33.381246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:33.381471 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:33.381385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:33.381525 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:33.381512 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:33.381588 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:33.381570 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:58:35.381554536 +0000 UTC m=+237.358510191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:33.382090 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:33.381775 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:58:33.382090 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:33.381793 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c89d9f8-4xjkg: secret "image-registry-tls" not found Jun 11 16:58:33.382090 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:33.381840 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls podName:c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:35.381822929 +0000 UTC m=+237.358778598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls") pod "image-registry-54c89d9f8-4xjkg" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026") : secret "image-registry-tls" not found Jun 11 16:58:34.238181 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:34.238141 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" event={"ID":"15469931-c674-496c-8f28-c67e0a48f491","Type":"ContainerStarted","Data":"8d0f5889fc2278b9079503af66a9d0e48d4aed06d28f5d07832be547ef9e13be"} Jun 11 16:58:34.259534 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:34.259467 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pw6n7" podStartSLOduration=3.259447125 podStartE2EDuration="3.259447125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:32.256706785 +0000 UTC m=+234.233662463" watchObservedRunningTime="2026-06-11 16:58:34.259447125 +0000 UTC m=+236.236402826" Jun 11 16:58:34.373431 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:34.373404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:34.472220 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:34.472186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:35.245957 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.245931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/0.log" Jun 11 16:58:35.246424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.245971 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7d02125-cd09-487e-9f84-e5f8f4c7d669" containerID="28781b2dd8755f3f00cfc215f6bf10db6f644a0ce3d2d4299aea786c0060ebc8" exitCode=255 Jun 11 16:58:35.246424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.246002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" event={"ID":"e7d02125-cd09-487e-9f84-e5f8f4c7d669","Type":"ContainerDied","Data":"28781b2dd8755f3f00cfc215f6bf10db6f644a0ce3d2d4299aea786c0060ebc8"} Jun 11 16:58:35.246424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.246232 2579 scope.go:117] "RemoveContainer" containerID="28781b2dd8755f3f00cfc215f6bf10db6f644a0ce3d2d4299aea786c0060ebc8" Jun 11 16:58:35.276925 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.276868 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvftv" podStartSLOduration=3.198815755 podStartE2EDuration="4.276852414s" totalImagesPullingTime="1.078036659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:34.258850411 +0000 UTC m=+236.235806089" watchObservedRunningTime="2026-06-11 16:58:35.276852414 +0000 UTC m=+237.253808146" Jun 11 16:58:35.400088 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.400058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:35.400229 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:35.400124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:35.400229 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:35.400212 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:35.400309 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:35.400243 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:58:35.400309 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:35.400258 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c89d9f8-4xjkg: secret "image-registry-tls" not found Jun 11 16:58:35.400309 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:35.400300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:58:39.40027939 +0000 UTC m=+241.377235064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:35.400425 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:35.400318 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls podName:c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:39.400308715 +0000 UTC m=+241.377264373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls") pod "image-registry-54c89d9f8-4xjkg" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026") : secret "image-registry-tls" not found Jun 11 16:58:36.251185 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 16:58:36.251564 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251551 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/0.log" Jun 11 16:58:36.251618 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251584 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7d02125-cd09-487e-9f84-e5f8f4c7d669" containerID="44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1" exitCode=255 Jun 11 16:58:36.251656 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" event={"ID":"e7d02125-cd09-487e-9f84-e5f8f4c7d669","Type":"ContainerDied","Data":"44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1"} Jun 11 16:58:36.251702 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251661 2579 scope.go:117] "RemoveContainer" containerID="28781b2dd8755f3f00cfc215f6bf10db6f644a0ce3d2d4299aea786c0060ebc8" Jun 11 16:58:36.251885 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.251869 2579 scope.go:117] "RemoveContainer" containerID="44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1" Jun 11 16:58:36.252083 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:36.252059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ttqcl_openshift-console-operator(e7d02125-cd09-487e-9f84-e5f8f4c7d669)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" podUID="e7d02125-cd09-487e-9f84-e5f8f4c7d669" Jun 11 16:58:36.560343 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.560266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:36.671731 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.671702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:36.842429 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.842354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:36.943061 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:36.943028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:37.043137 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:37.043109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:37.243775 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:37.243701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:37.256137 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:37.256111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 16:58:37.256482 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:37.256426 2579 scope.go:117] "RemoveContainer" containerID="44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1" Jun 11 16:58:37.256613 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:37.256593 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ttqcl_openshift-console-operator(e7d02125-cd09-487e-9f84-e5f8f4c7d669)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" podUID="e7d02125-cd09-487e-9f84-e5f8f4c7d669" Jun 11 16:58:37.398561 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:37.398537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:38.661427 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.661396 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vbphz_40aed566-4224-4280-a5b1-b13adfda62de/dns-node-resolver/0.log" Jun 11 16:58:38.814135 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.814104 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-l8w5b"] Jun 11 16:58:38.818433 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.818416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:38.820869 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.820845 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-x8kjr\"" Jun 11 16:58:38.821640 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.821606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 16:58:38.821750 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.821611 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 16:58:38.821750 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.821611 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 16:58:38.822134 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.822120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 16:58:38.835712 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.835690 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-l8w5b"] Jun 11 16:58:38.864064 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.864031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:38.928939 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.928850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-cabundle\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:38.928939 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.928902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvt4\" (UniqueName: \"kubernetes.io/projected/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-kube-api-access-jzvt4\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:38.929076 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.929039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-key\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:38.955296 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:38.955264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:39.029835 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.029804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-cabundle\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.029989 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.029857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvt4\" (UniqueName: \"kubernetes.io/projected/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-kube-api-access-jzvt4\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.030051 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.030002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-key\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.030509 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.030487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-cabundle\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.032309 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.032289 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-signing-key\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.038292 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.038264 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvt4\" (UniqueName: \"kubernetes.io/projected/1e9f9f61-74d3-414b-b91d-4f8e2c67f266-kube-api-access-jzvt4\") pod \"service-ca-7d74d578b8-l8w5b\" (UID: \"1e9f9f61-74d3-414b-b91d-4f8e2c67f266\") " pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.127269 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.127229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" Jun 11 16:58:39.258723 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.258682 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-l8w5b"] Jun 11 16:58:39.264254 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.264231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22qsf_0482ee12-b8a6-451a-9cbb-c70fc7435a62/node-ca/0.log" Jun 11 16:58:39.265176 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:58:39.265155 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9f9f61_74d3_414b_b91d_4f8e2c67f266.slice/crio-42a4e3496463d05889221fbee3a4098d5481c2ab46b6ed39351395f0abdcfd74 WatchSource:0}: Error finding container 42a4e3496463d05889221fbee3a4098d5481c2ab46b6ed39351395f0abdcfd74: Status 404 returned error can't find the container with id 42a4e3496463d05889221fbee3a4098d5481c2ab46b6ed39351395f0abdcfd74 Jun 11 16:58:39.286153 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.286126 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:39.391784 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.391758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:39.433057 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.433016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:39.433208 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:39.433080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:39.433208 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:39.433176 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:39.433208 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:39.433197 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:58:39.433208 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:39.433207 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c89d9f8-4xjkg: secret "image-registry-tls" not found Jun 11 16:58:39.433337 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:39.433240 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:58:47.433224819 +0000 UTC m=+249.410180493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:39.433337 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:39.433257 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls podName:c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026 nodeName:}" failed. No retries permitted until 2026-06-11 16:58:47.433250607 +0000 UTC m=+249.410206262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls") pod "image-registry-54c89d9f8-4xjkg" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026") : secret "image-registry-tls" not found Jun 11 16:58:40.065014 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:40.064979 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmlsv_662e86eb-499b-4a2f-bfb0-23bf36c01f7d/serve-healthcheck-canary/0.log" Jun 11 16:58:40.229538 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:40.229504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:40.266882 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:40.266844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" event={"ID":"1e9f9f61-74d3-414b-b91d-4f8e2c67f266","Type":"ContainerStarted","Data":"42a4e3496463d05889221fbee3a4098d5481c2ab46b6ed39351395f0abdcfd74"} Jun 11 16:58:42.100855 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:42.100811 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:42.100855 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:42.100864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:42.101295 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:42.101180 2579 scope.go:117] "RemoveContainer" containerID="44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1" Jun 11 16:58:42.101342 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:42.101322 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ttqcl_openshift-console-operator(e7d02125-cd09-487e-9f84-e5f8f4c7d669)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" podUID="e7d02125-cd09-487e-9f84-e5f8f4c7d669" Jun 11 16:58:42.274007 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:42.273968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" event={"ID":"1e9f9f61-74d3-414b-b91d-4f8e2c67f266","Type":"ContainerStarted","Data":"12e53cec479737e31f77a4699a6cc931dd301714de4d3f39af18175b981fb4fd"} Jun 11 16:58:42.303347 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:42.303285 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-l8w5b" podStartSLOduration=2.306538256 podStartE2EDuration="4.303262562s" totalImagesPullingTime="1.996724306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:42.300294687 +0000 UTC m=+244.277250363" watchObservedRunningTime="2026-06-11 16:58:42.303262562 +0000 UTC m=+244.280218237" Jun 11 16:58:43.088050 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:43.088014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:43.218036 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:43.217999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:43.363092 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:43.362998 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:43.474290 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:43.474257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:43.635025 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:43.634944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:44.152365 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:44.152331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:44.559781 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:44.559742 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:44.970052 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:44.969970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:45.157786 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:45.157754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:45.304058 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:45.304024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:45.773485 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:45.773455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:46.164550 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:46.164459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:46.563336 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:46.563301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:46.982356 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:46.982263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:47.129361 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.129329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:47.217953 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.217902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:47.499358 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.499314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:58:47.499529 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.499378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:47.499529 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:47.499490 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:47.499603 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:47.499572 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls podName:7bfebf20-d7d3-4c3d-b248-9f89df2991bf nodeName:}" failed. No retries permitted until 2026-06-11 16:59:03.499551648 +0000 UTC m=+265.476507322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zcpj5" (UID: "7bfebf20-d7d3-4c3d-b248-9f89df2991bf") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:58:47.501764 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.501738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"image-registry-54c89d9f8-4xjkg\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:47.608258 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.608224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x475h\"" Jun 11 16:58:47.616182 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.616158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:47.754795 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.754702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:58:47.757085 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:58:47.757055 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67b7a5f_4dd4_4d62_8c57_2c4f59e1d026.slice/crio-5910c3b4684dca9ea1999f65177dc70bd3c6f95dc63249a6a93fe42622adfec6 WatchSource:0}: Error finding container 5910c3b4684dca9ea1999f65177dc70bd3c6f95dc63249a6a93fe42622adfec6: Status 404 returned error can't find the container with id 5910c3b4684dca9ea1999f65177dc70bd3c6f95dc63249a6a93fe42622adfec6 Jun 11 16:58:47.758522 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:47.758498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:48.161317 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.161238 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:48.293799 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.293768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" event={"ID":"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026","Type":"ContainerStarted","Data":"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034"} Jun 11 16:58:48.294000 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.293819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" event={"ID":"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026","Type":"ContainerStarted","Data":"5910c3b4684dca9ea1999f65177dc70bd3c6f95dc63249a6a93fe42622adfec6"} Jun 11 16:58:48.294000 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.293857 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:58:48.335015 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.334972 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" podStartSLOduration=17.334956435 podStartE2EDuration="17.334956435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:48.333618446 +0000 UTC m=+250.310574123" watchObservedRunningTime="2026-06-11 16:58:48.334956435 +0000 UTC m=+250.311912112" Jun 11 16:58:48.400140 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.400108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:48.559633 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:48.559591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:49.419542 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:49.419498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:58:49.420073 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:49.419704 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:58:49.420073 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:58:49.419785 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs podName:ce3db5f5-7012-41e6-85cb-f2afb8af4224 nodeName:}" failed. No retries permitted until 2026-06-11 17:00:51.419764436 +0000 UTC m=+373.396720111 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs") pod "network-metrics-daemon-gq2cz" (UID: "ce3db5f5-7012-41e6-85cb-f2afb8af4224") : secret "metrics-daemon-secret" not found Jun 11 16:58:49.588653 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:49.588624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:49.689867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:49.689792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:49.969297 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:49.969219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:50.159213 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:50.159177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:50.370064 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:50.370015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:50.585433 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:50.585380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:51.546891 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:51.546858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:51.680044 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:51.680010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:51.967015 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:51.966931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:52.153508 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:52.153474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:52.353993 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:52.353962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:52.552582 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:52.552547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:53.348320 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:53.348284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:53.555162 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:53.555132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:53.762873 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:53.762844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:56.502379 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:56.502352 2579 scope.go:117] "RemoveContainer" containerID="44dd4333ff7bf56eebbeee1bdd2679a985711c5576fd8258e2104730b8393cf1" Jun 11 16:58:57.166210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.166176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:57.266155 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.266120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:57.322187 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.322163 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 16:58:57.322332 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.322247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" event={"ID":"e7d02125-cd09-487e-9f84-e5f8f4c7d669","Type":"ContainerStarted","Data":"39935cdb744e38dbc1abd4b57cf2a3d115066638667795358bb125d48806f8d8"} Jun 11 16:58:57.322539 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.322516 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:57.327288 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.327266 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" Jun 11 16:58:57.342746 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.342699 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-ttqcl" podStartSLOduration=24.241470409 podStartE2EDuration="26.342686269s" totalImagesPullingTime="2.10121586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:58:57.34125642 +0000 UTC m=+259.318212097" watchObservedRunningTime="2026-06-11 16:58:57.342686269 +0000 UTC m=+259.319641945" Jun 11 16:58:57.412640 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.412608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:57.791999 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.791969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:57.852810 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:57.852781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.202883 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.202803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.273744 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.273712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.397368 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.397336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.456938 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.456831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.659534 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.659501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:58.826716 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:58.826686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:59.367893 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:58:59.367862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:00.025819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:00.025788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:00.089372 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:00.089345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:01.842814 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.842772 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:59:01.848186 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.848161 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-8rdp8"] Jun 11 16:59:01.850858 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.850838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:01.854242 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.854226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9qf5b\"" Jun 11 16:59:01.854561 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.854538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:59:01.854662 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.854608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:59:01.889317 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.889287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8rdp8"] Jun 11 16:59:01.913150 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.913123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5ct\" (UniqueName: \"kubernetes.io/projected/6dcbecf2-400c-4722-9d1e-4c6996089564-kube-api-access-9z5ct\") pod \"downloads-6657875f97-8rdp8\" (UID: \"6dcbecf2-400c-4722-9d1e-4c6996089564\") " pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:01.975001 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.974966 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lpbr4"] Jun 11 16:59:01.978130 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.978110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:01.982315 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.982294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:59:01.982424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.982338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bjndh\"" Jun 11 16:59:01.982474 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.982294 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:59:01.982605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.982571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:59:01.982605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:01.982578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:59:02.005564 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.005537 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lpbr4"] Jun 11 16:59:02.013663 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5eb1267-3a66-418e-b626-53f76c86ad45-crio-socket\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.013764 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5eb1267-3a66-418e-b626-53f76c86ad45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.013764 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5ct\" (UniqueName: \"kubernetes.io/projected/6dcbecf2-400c-4722-9d1e-4c6996089564-kube-api-access-9z5ct\") pod \"downloads-6657875f97-8rdp8\" (UID: \"6dcbecf2-400c-4722-9d1e-4c6996089564\") " pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:02.013855 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbks\" (UniqueName: \"kubernetes.io/projected/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-api-access-bdbks\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.013855 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5eb1267-3a66-418e-b626-53f76c86ad45-data-volume\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.013855 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.013841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.034756 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.034727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5ct\" (UniqueName: \"kubernetes.io/projected/6dcbecf2-400c-4722-9d1e-4c6996089564-kube-api-access-9z5ct\") pod \"downloads-6657875f97-8rdp8\" (UID: \"6dcbecf2-400c-4722-9d1e-4c6996089564\") " pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:02.038306 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.038279 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:02.115018 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.114921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5eb1267-3a66-418e-b626-53f76c86ad45-data-volume\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115018 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.114965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115018 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5eb1267-3a66-418e-b626-53f76c86ad45-crio-socket\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5eb1267-3a66-418e-b626-53f76c86ad45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbks\" (UniqueName: \"kubernetes.io/projected/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-api-access-bdbks\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5eb1267-3a66-418e-b626-53f76c86ad45-crio-socket\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115255 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5eb1267-3a66-418e-b626-53f76c86ad45-data-volume\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.115582 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.115557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.117486 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.117465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5eb1267-3a66-418e-b626-53f76c86ad45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.126878 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.126853 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbks\" (UniqueName: \"kubernetes.io/projected/a5eb1267-3a66-418e-b626-53f76c86ad45-kube-api-access-bdbks\") pod \"insights-runtime-extractor-lpbr4\" (UID: \"a5eb1267-3a66-418e-b626-53f76c86ad45\") " pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.142227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.142200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:02.160301 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.160278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:02.250689 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.250662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:02.287886 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.287847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lpbr4" Jun 11 16:59:02.300264 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.300238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8rdp8"] Jun 11 16:59:02.303154 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:02.303128 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcbecf2_400c_4722_9d1e_4c6996089564.slice/crio-89ea69643e902e79c2d24ccbaf319825c29e6f6c6be4b68ed52cd60594967839 WatchSource:0}: Error finding container 89ea69643e902e79c2d24ccbaf319825c29e6f6c6be4b68ed52cd60594967839: Status 404 returned error can't find the container with id 89ea69643e902e79c2d24ccbaf319825c29e6f6c6be4b68ed52cd60594967839 Jun 11 16:59:02.340479 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.340438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8rdp8" event={"ID":"6dcbecf2-400c-4722-9d1e-4c6996089564","Type":"ContainerStarted","Data":"89ea69643e902e79c2d24ccbaf319825c29e6f6c6be4b68ed52cd60594967839"} Jun 11 16:59:02.429287 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:02.429252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lpbr4"] Jun 11 16:59:02.432283 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:02.432255 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eb1267_3a66_418e_b626_53f76c86ad45.slice/crio-ebd2bd08461a23b6d99691af5d67cf28d89c9df541bdd7da0601f74c432331e9 WatchSource:0}: Error finding container ebd2bd08461a23b6d99691af5d67cf28d89c9df541bdd7da0601f74c432331e9: Status 404 returned error can't find the container with id ebd2bd08461a23b6d99691af5d67cf28d89c9df541bdd7da0601f74c432331e9 Jun 11 16:59:03.346325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.346238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpbr4" event={"ID":"a5eb1267-3a66-418e-b626-53f76c86ad45","Type":"ContainerStarted","Data":"aea9c7a4f570234e5b9967d84df857301f1db51345c2addb35dea17e3c5cc583"} Jun 11 16:59:03.346325 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.346309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpbr4" event={"ID":"a5eb1267-3a66-418e-b626-53f76c86ad45","Type":"ContainerStarted","Data":"86aacc48bf64df899e2c98e7a17e709fbaeb492e6d713a1cb71f64dbd213b027"} Jun 11 16:59:03.346722 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.346338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpbr4" event={"ID":"a5eb1267-3a66-418e-b626-53f76c86ad45","Type":"ContainerStarted","Data":"ebd2bd08461a23b6d99691af5d67cf28d89c9df541bdd7da0601f74c432331e9"} Jun 11 16:59:03.526682 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.526636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:59:03.530100 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.530070 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7bfebf20-d7d3-4c3d-b248-9f89df2991bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zcpj5\" (UID: \"7bfebf20-d7d3-4c3d-b248-9f89df2991bf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:59:03.795377 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.795338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t72w7\"" Jun 11 16:59:03.803534 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.803502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" Jun 11 16:59:03.954151 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:03.952936 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5"] Jun 11 16:59:03.960282 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:03.960250 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfebf20_d7d3_4c3d_b248_9f89df2991bf.slice/crio-94e8c1e886674171cd6b5237cde4610789dd485c6a20741f2a2a293343bb3b0a WatchSource:0}: Error finding container 94e8c1e886674171cd6b5237cde4610789dd485c6a20741f2a2a293343bb3b0a: Status 404 returned error can't find the container with id 94e8c1e886674171cd6b5237cde4610789dd485c6a20741f2a2a293343bb3b0a Jun 11 16:59:04.351652 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:04.351604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" event={"ID":"7bfebf20-d7d3-4c3d-b248-9f89df2991bf","Type":"ContainerStarted","Data":"94e8c1e886674171cd6b5237cde4610789dd485c6a20741f2a2a293343bb3b0a"} Jun 11 16:59:05.357530 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:05.357492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lpbr4" event={"ID":"a5eb1267-3a66-418e-b626-53f76c86ad45","Type":"ContainerStarted","Data":"e1c5a3bfcc5a4fc00e7d07a631417c92ff7686cd19aeb75ea8651dc31988d200"} Jun 11 16:59:05.377657 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:05.377595 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lpbr4" podStartSLOduration=2.254999039 podStartE2EDuration="4.377572262s" totalImagesPullingTime="2.122573223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:59:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:05.375868662 +0000 UTC m=+267.352824340" watchObservedRunningTime="2026-06-11 16:59:05.377572262 +0000 UTC m=+267.354527940" Jun 11 16:59:06.363705 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.363663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" event={"ID":"7bfebf20-d7d3-4c3d-b248-9f89df2991bf","Type":"ContainerStarted","Data":"8a38d481b4a8d0d526e9cf478ffc31b6d16635a471661171b5cbff70e4fd3085"} Jun 11 16:59:06.378953 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.378919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:06.479823 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.479786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:06.562327 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.562265 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zcpj5" podStartSLOduration=33.536570473 podStartE2EDuration="35.562239226s" totalImagesPullingTime="2.025668753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:06.395114682 +0000 UTC m=+268.372070359" watchObservedRunningTime="2026-06-11 16:59:06.562239226 +0000 UTC m=+268.539194905" Jun 11 16:59:06.563268 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.563243 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx"] Jun 11 16:59:06.566526 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.566505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:06.569088 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.568929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:59:06.569088 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.569028 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pjkfd\"" Jun 11 16:59:06.572757 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.572726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:06.575428 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.575402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx"] Jun 11 16:59:06.653224 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.653140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4cglx\" (UID: \"f3bea835-2fcf-4c07-9837-1f432d69b5df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:06.754485 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:06.754450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4cglx\" (UID: \"f3bea835-2fcf-4c07-9837-1f432d69b5df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:06.754651 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:06.754622 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:59:06.754730 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:06.754717 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates podName:f3bea835-2fcf-4c07-9837-1f432d69b5df nodeName:}" failed. No retries permitted until 2026-06-11 16:59:07.254695849 +0000 UTC m=+269.231651519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-4cglx" (UID: "f3bea835-2fcf-4c07-9837-1f432d69b5df") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:59:07.121559 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:07.121520 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:07.258428 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:07.258392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4cglx\" (UID: \"f3bea835-2fcf-4c07-9837-1f432d69b5df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:07.260705 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:07.260678 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3bea835-2fcf-4c07-9837-1f432d69b5df-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4cglx\" (UID: \"f3bea835-2fcf-4c07-9837-1f432d69b5df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:07.478493 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:07.478413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:07.623811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:07.623773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx"] Jun 11 16:59:07.627984 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:07.627957 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bea835_2fcf_4c07_9837_1f432d69b5df.slice/crio-e41f0caa0a93fe36493d4462df464794a7ea37588068317ef8ca4c2d8fbbd89f WatchSource:0}: Error finding container e41f0caa0a93fe36493d4462df464794a7ea37588068317ef8ca4c2d8fbbd89f: Status 404 returned error can't find the container with id e41f0caa0a93fe36493d4462df464794a7ea37588068317ef8ca4c2d8fbbd89f Jun 11 16:59:08.372808 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:08.372735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" event={"ID":"f3bea835-2fcf-4c07-9837-1f432d69b5df","Type":"ContainerStarted","Data":"e41f0caa0a93fe36493d4462df464794a7ea37588068317ef8ca4c2d8fbbd89f"} Jun 11 16:59:09.378309 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.378270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" event={"ID":"f3bea835-2fcf-4c07-9837-1f432d69b5df","Type":"ContainerStarted","Data":"a16b87e478910b9db289fcd71c78d439a0055b0518bad753084fb0f255dd3724"} Jun 11 16:59:09.378765 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.378435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:09.383944 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.383902 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" Jun 11 16:59:09.397162 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.397107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4cglx" podStartSLOduration=2.386288342 podStartE2EDuration="3.397090667s" totalImagesPullingTime="1.010802325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:09.397013633 +0000 UTC m=+271.373969309" watchObservedRunningTime="2026-06-11 16:59:09.397090667 +0000 UTC m=+271.374046340" Jun 11 16:59:09.618045 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.618008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:09.645689 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.645605 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj"] Jun 11 16:59:09.649295 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.649273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.652533 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.652510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-p2p5w\"" Jun 11 16:59:09.652768 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.652755 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 16:59:09.652991 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.652977 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 16:59:09.653049 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.653040 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:59:09.660867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.660843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj"] Jun 11 16:59:09.680767 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.680735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t768b\" (UniqueName: \"kubernetes.io/projected/0ef291c0-04c2-4017-98c1-5128cf8f33cd-kube-api-access-t768b\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.680918 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.680783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.680918 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.680841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef291c0-04c2-4017-98c1-5128cf8f33cd-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.681033 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.680941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.698471 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.698442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:09.781404 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.781375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t768b\" (UniqueName: \"kubernetes.io/projected/0ef291c0-04c2-4017-98c1-5128cf8f33cd-kube-api-access-t768b\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.781548 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.781412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.781548 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.781465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef291c0-04c2-4017-98c1-5128cf8f33cd-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.781548 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.781508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.781685 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:09.781579 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 16:59:09.781685 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:09.781644 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls podName:0ef291c0-04c2-4017-98c1-5128cf8f33cd nodeName:}" failed. No retries permitted until 2026-06-11 16:59:10.281623171 +0000 UTC m=+272.258578832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-k2pdj" (UID: "0ef291c0-04c2-4017-98c1-5128cf8f33cd") : secret "prometheus-operator-tls" not found Jun 11 16:59:09.782402 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.782377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef291c0-04c2-4017-98c1-5128cf8f33cd-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.784175 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.784148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.792652 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.792629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t768b\" (UniqueName: \"kubernetes.io/projected/0ef291c0-04c2-4017-98c1-5128cf8f33cd-kube-api-access-t768b\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:09.992072 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:09.992001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:10.286862 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:10.286823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:10.289495 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:10.289462 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef291c0-04c2-4017-98c1-5128cf8f33cd-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-k2pdj\" (UID: \"0ef291c0-04c2-4017-98c1-5128cf8f33cd\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:10.560770 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:10.560682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" Jun 11 16:59:10.709001 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:10.708939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj"] Jun 11 16:59:10.711353 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:10.711328 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef291c0_04c2_4017_98c1_5128cf8f33cd.slice/crio-6b3965804b6206ee731e01160a18a340ec6a94f57ea01db395134769667f4876 WatchSource:0}: Error finding container 6b3965804b6206ee731e01160a18a340ec6a94f57ea01db395134769667f4876: Status 404 returned error can't find the container with id 6b3965804b6206ee731e01160a18a340ec6a94f57ea01db395134769667f4876 Jun 11 16:59:11.388294 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:11.388237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" event={"ID":"0ef291c0-04c2-4017-98c1-5128cf8f33cd","Type":"ContainerStarted","Data":"6b3965804b6206ee731e01160a18a340ec6a94f57ea01db395134769667f4876"} Jun 11 16:59:11.850360 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:11.850317 2579 patch_prober.go:28] interesting pod/image-registry-54c89d9f8-4xjkg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:59:11.850833 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:11.850380 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:59:12.225803 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.225720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:12.330550 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.330496 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:12.393263 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.393228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" event={"ID":"0ef291c0-04c2-4017-98c1-5128cf8f33cd","Type":"ContainerStarted","Data":"975911aa463c5f06ed7ce8fba395f9264b484bdca54cd2cba9b6939ecef97413"} Jun 11 16:59:12.393438 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.393292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" event={"ID":"0ef291c0-04c2-4017-98c1-5128cf8f33cd","Type":"ContainerStarted","Data":"f43bd574124d318e9b6ed38fa52cfef1cf05b4bed531f6632374cf6567ad0731"} Jun 11 16:59:12.413411 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.413349 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-k2pdj" podStartSLOduration=2.192236478 podStartE2EDuration="3.413330086s" totalImagesPullingTime="1.221093608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:12.413315679 +0000 UTC m=+274.390271357" watchObservedRunningTime="2026-06-11 16:59:12.413330086 +0000 UTC m=+274.390285764" Jun 11 16:59:12.421062 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.421024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:12.836410 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.836365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:12.937503 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:12.937470 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:13.961780 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:13.961739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.177865 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.177821 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.220938 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.220845 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6"] Jun 11 16:59:14.225953 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.225928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.228886 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.228682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:59:14.228886 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.228745 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:59:14.229085 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.228969 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4j8n2\"" Jun 11 16:59:14.241811 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.240424 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6"] Jun 11 16:59:14.244712 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.243666 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5"] Jun 11 16:59:14.250022 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.249988 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.252560 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.252539 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6xhmn\"" Jun 11 16:59:14.252756 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.252739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:59:14.253126 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.253112 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 16:59:14.253985 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.253963 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 16:59:14.272993 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.272944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5"] Jun 11 16:59:14.284785 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.284757 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v5zf5"] Jun 11 16:59:14.288197 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.288171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.288417 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.288404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.293227 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.293170 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:59:14.293340 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.293294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvx74\"" Jun 11 16:59:14.297623 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.297590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:59:14.297623 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.297612 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:59:14.324842 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.324738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.324842 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.324785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m4j7\" (UniqueName: \"kubernetes.io/projected/a79b8154-a0f3-40f2-95b5-0b87790ffd14-kube-api-access-9m4j7\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.325091 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.324857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.325091 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.324898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.325091 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6298ea9d-7f14-4006-af6e-d6651136b199-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.325091 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.325091 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79b8154-a0f3-40f2-95b5-0b87790ffd14-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.325338 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.325338 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.325338 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.325173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8kxr\" (UniqueName: \"kubernetes.io/projected/6298ea9d-7f14-4006-af6e-d6651136b199-kube-api-access-q8kxr\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79b8154-a0f3-40f2-95b5-0b87790ffd14-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-wtmp\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8kxr\" (UniqueName: \"kubernetes.io/projected/6298ea9d-7f14-4006-af6e-d6651136b199-kube-api-access-q8kxr\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-textfile\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m4j7\" (UniqueName: \"kubernetes.io/projected/a79b8154-a0f3-40f2-95b5-0b87790ffd14-kube-api-access-9m4j7\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.426997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-sys\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.427732 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-metrics-client-ca\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6298ea9d-7f14-4006-af6e-d6651136b199-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-root\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbwh2\" (UniqueName: \"kubernetes.io/projected/467875c9-bda8-4215-af83-5ffc7a2492ef-kube-api-access-pbwh2\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.427646 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.427732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls podName:6298ea9d-7f14-4006-af6e-d6651136b199 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:14.927711154 +0000 UTC m=+276.904666830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-g4cr5" (UID: "6298ea9d-7f14-4006-af6e-d6651136b199") : secret "kube-state-metrics-tls" not found Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.427942 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.427977 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6298ea9d-7f14-4006-af6e-d6651136b199-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.428600 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.427990 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls podName:a79b8154-a0f3-40f2-95b5-0b87790ffd14 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:14.927975846 +0000 UTC m=+276.904931509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-spsd6" (UID: "a79b8154-a0f3-40f2-95b5-0b87790ffd14") : secret "openshift-state-metrics-tls" not found Jun 11 16:59:14.429088 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.428647 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6298ea9d-7f14-4006-af6e-d6651136b199-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.429088 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.428726 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79b8154-a0f3-40f2-95b5-0b87790ffd14-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.430868 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.430838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.431453 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.431407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.453818 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.453691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8kxr\" (UniqueName: \"kubernetes.io/projected/6298ea9d-7f14-4006-af6e-d6651136b199-kube-api-access-q8kxr\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.454718 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.454691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m4j7\" (UniqueName: \"kubernetes.io/projected/a79b8154-a0f3-40f2-95b5-0b87790ffd14-kube-api-access-9m4j7\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.527958 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.527901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-root\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.527976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbwh2\" (UniqueName: \"kubernetes.io/projected/467875c9-bda8-4215-af83-5ffc7a2492ef-kube-api-access-pbwh2\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.527998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-root\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-wtmp\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528158 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-wtmp\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-textfile\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528439 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528439 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.528291 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:59:14.528439 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:14.528351 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls podName:467875c9-bda8-4215-af83-5ffc7a2492ef nodeName:}" failed. No retries permitted until 2026-06-11 16:59:15.028332522 +0000 UTC m=+277.005288183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls") pod "node-exporter-v5zf5" (UID: "467875c9-bda8-4215-af83-5ffc7a2492ef") : secret "node-exporter-tls" not found Jun 11 16:59:14.528673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-sys\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-metrics-client-ca\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467875c9-bda8-4215-af83-5ffc7a2492ef-sys\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-textfile\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.528948 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.528904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.529023 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.529007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467875c9-bda8-4215-af83-5ffc7a2492ef-metrics-client-ca\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.530879 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.530850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.546321 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.546292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbwh2\" (UniqueName: \"kubernetes.io/projected/467875c9-bda8-4215-af83-5ffc7a2492ef-kube-api-access-pbwh2\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:14.616159 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.616121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.703886 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.703847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.804181 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.804059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.904312 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.904282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:14.932642 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.932607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:14.932837 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.932659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.935438 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.935411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a79b8154-a0f3-40f2-95b5-0b87790ffd14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-spsd6\" (UID: \"a79b8154-a0f3-40f2-95b5-0b87790ffd14\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:14.935667 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:14.935620 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6298ea9d-7f14-4006-af6e-d6651136b199-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g4cr5\" (UID: \"6298ea9d-7f14-4006-af6e-d6651136b199\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:15.033926 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.033871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:15.036478 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.036446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/467875c9-bda8-4215-af83-5ffc7a2492ef-node-exporter-tls\") pod \"node-exporter-v5zf5\" (UID: \"467875c9-bda8-4215-af83-5ffc7a2492ef\") " pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:15.120756 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.120666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:15.141677 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.141644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" Jun 11 16:59:15.161060 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.161033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" Jun 11 16:59:15.200266 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.200193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5zf5" Jun 11 16:59:15.226363 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.226307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:15.241239 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.241210 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:59:15.245397 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.245373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.249805 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.249762 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 16:59:15.250117 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.250072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 16:59:15.251530 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 16:59:15.251615 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251552 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 16:59:15.251655 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251605 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 16:59:15.251655 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 16:59:15.251837 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251820 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 16:59:15.251870 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.251834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gk8gh\"" Jun 11 16:59:15.252023 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.252005 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 16:59:15.252114 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.252088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 16:59:15.281519 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.281485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:59:15.337895 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.337758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.337895 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.337809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.337895 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.337839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338195 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.337981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338195 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmb9q\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338195 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338347 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338347 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338445 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338445 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338543 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338543 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.338543 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.338515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.439673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.439587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.439673 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.439638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmb9q\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.439968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.440290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.440399 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:15.440368 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 16:59:15.440994 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:15.440429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls podName:3fa90fe3-45e6-47a1-8ee1-1415217100b0 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:15.940409617 +0000 UTC m=+277.917365277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0") : secret "alertmanager-main-tls" not found Jun 11 16:59:15.442172 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.442146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.442625 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.442601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.442706 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.442665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.442762 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.442701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.443130 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.443087 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.445424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.445373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.445813 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.445755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.446331 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.446282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.446758 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.446500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.446758 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.446719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.447385 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.447345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.447499 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.447475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.448313 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.448288 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.454202 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.454181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmb9q\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.947729 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:15.947396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:15.947729 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:15.947578 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 16:59:15.948556 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:15.948112 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls podName:3fa90fe3-45e6-47a1-8ee1-1415217100b0 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:16.947634682 +0000 UTC m=+278.924590338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0") : secret "alertmanager-main-tls" not found Jun 11 16:59:16.142112 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:16.142069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:16.956203 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:16.956163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:16.958864 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:16.958837 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:17.057151 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.057113 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:59:17.229285 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.229205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:17.326559 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.326523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:17.444206 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.444159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:17.645552 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.645513 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:17.741871 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.741832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:17.836117 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.836012 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 16:59:17.839379 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.839356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.841897 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.841868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:59:17.842647 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.842623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:59:17.842802 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.842728 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:59:17.842802 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.842729 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jm9z8\"" Jun 11 16:59:17.842961 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.842859 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:59:17.843632 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.843614 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:59:17.848701 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.848534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:59:17.849796 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.849724 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 16:59:17.967339 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967525 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967525 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967525 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967689 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvkg\" (UniqueName: \"kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967689 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:17.967689 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:17.967622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.066867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.066833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:18.069005 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.068981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069111 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069172 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069225 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069279 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvkg\" (UniqueName: \"kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069334 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069334 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069826 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069968 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.069968 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.069948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.070417 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.070395 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.072306 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.072284 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.072306 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.072297 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.078425 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.078406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvkg\" (UniqueName: \"kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg\") pod \"console-7c7889f45b-gjs6l\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.151485 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.151402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:18.870577 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.870539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:18.894646 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.894610 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9cz64"] Jun 11 16:59:18.898475 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.898449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:18.905196 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.905087 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nldwk\"" Jun 11 16:59:18.908121 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.906275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 16:59:18.915048 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.915014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9cz64"] Jun 11 16:59:18.969804 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.969761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:18.977011 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.976966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:18.977181 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:18.977048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzrb\" (UniqueName: \"kubernetes.io/projected/d7444039-6ea0-49bb-a209-a9d509f863f2-kube-api-access-chzrb\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.078371 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.078341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.078538 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.078406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzrb\" (UniqueName: \"kubernetes.io/projected/d7444039-6ea0-49bb-a209-a9d509f863f2-kube-api-access-chzrb\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.078538 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:19.078480 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 16:59:19.078642 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:19.078566 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert podName:d7444039-6ea0-49bb-a209-a9d509f863f2 nodeName:}" failed. No retries permitted until 2026-06-11 16:59:19.578544536 +0000 UTC m=+281.555500208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-9cz64" (UID: "d7444039-6ea0-49bb-a209-a9d509f863f2") : secret "monitoring-plugin-cert" not found Jun 11 16:59:19.092065 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.092030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzrb\" (UniqueName: \"kubernetes.io/projected/d7444039-6ea0-49bb-a209-a9d509f863f2-kube-api-access-chzrb\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.226229 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.226141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:19.582824 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.582777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.585491 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.585463 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7444039-6ea0-49bb-a209-a9d509f863f2-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9cz64\" (UID: \"d7444039-6ea0-49bb-a209-a9d509f863f2\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:19.812104 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:19.812066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:20.053733 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:20.053680 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8jx4f" podUID="c898b89f-feaf-41d1-8310-cd479dbef86f" Jun 11 16:59:20.426605 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.426520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:20.488424 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.488382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:20.489924 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.489888 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:59:20.495204 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.494207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.498324 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.498152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 16:59:20.498324 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.498185 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 16:59:20.498977 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.498950 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.498988 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrd5s\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499048 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499071 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.498957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 16:59:20.499098 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499026 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 16:59:20.499392 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499361 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 16:59:20.499392 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499371 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 16:59:20.499498 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499394 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 16:59:20.499541 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.499518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 16:59:20.502229 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.501993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 16:59:20.502229 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.502050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:59:20.503945 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.503395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9a01ipheu0el7\"" Jun 11 16:59:20.504438 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.504417 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 16:59:20.512025 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.511998 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:59:20.592995 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.592958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.592995 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593256 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5rv\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593256 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593256 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593415 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593415 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593415 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593415 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593415 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593625 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593625 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593625 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593625 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.593819 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.594092 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.593820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696426 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696426 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696426 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5rv\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.696720 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.696834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697148 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697647 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697588 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.697854 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.697824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.698186 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.698159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700283 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.699953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700283 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.699997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700283 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.700073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700492 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.700421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700611 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.700588 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.700871 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.700847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.701031 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.701008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.701792 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.701745 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.702095 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.702072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.702856 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.702578 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.703001 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.702976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.703430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.703407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.703505 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.703472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.704007 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.703984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.704878 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.704854 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.708126 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.708100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5rv\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv\") pod \"prometheus-k8s-0\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:20.809489 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:20.809446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:21.257392 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:21.257351 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467875c9_bda8_4215_af83_5ffc7a2492ef.slice/crio-ca7e7f7c201962541ad7a16d83295650f2f478ccc5d0ce4298bcf12d6e8ac00d WatchSource:0}: Error finding container ca7e7f7c201962541ad7a16d83295650f2f478ccc5d0ce4298bcf12d6e8ac00d: Status 404 returned error can't find the container with id ca7e7f7c201962541ad7a16d83295650f2f478ccc5d0ce4298bcf12d6e8ac00d Jun 11 16:59:21.436144 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.436096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zf5" event={"ID":"467875c9-bda8-4215-af83-5ffc7a2492ef","Type":"ContainerStarted","Data":"ca7e7f7c201962541ad7a16d83295650f2f478ccc5d0ce4298bcf12d6e8ac00d"} Jun 11 16:59:21.445707 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.445656 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6"] Jun 11 16:59:21.457182 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:21.456812 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79b8154_a0f3_40f2_95b5_0b87790ffd14.slice/crio-1304e99705d6f091fcc68f9a18eace66a5b82ee006035772912c771a26db3cc6 WatchSource:0}: Error finding container 1304e99705d6f091fcc68f9a18eace66a5b82ee006035772912c771a26db3cc6: Status 404 returned error can't find the container with id 1304e99705d6f091fcc68f9a18eace66a5b82ee006035772912c771a26db3cc6 Jun 11 16:59:21.483072 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.483031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9cz64"] Jun 11 16:59:21.485341 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:21.485317 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7444039_6ea0_49bb_a209_a9d509f863f2.slice/crio-1925e602c1008db64de66e23d741cf93bbc82482f27b642261a06714241ee26c WatchSource:0}: Error finding container 1925e602c1008db64de66e23d741cf93bbc82482f27b642261a06714241ee26c: Status 404 returned error can't find the container with id 1925e602c1008db64de66e23d741cf93bbc82482f27b642261a06714241ee26c Jun 11 16:59:21.561551 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.561522 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:59:21.564324 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:21.564300 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa90fe3_45e6_47a1_8ee1_1415217100b0.slice/crio-4cdae484ad9b14745b9ba043592358c400017e028061413b0cdbdbbf8eaf0209 WatchSource:0}: Error finding container 4cdae484ad9b14745b9ba043592358c400017e028061413b0cdbdbbf8eaf0209: Status 404 returned error can't find the container with id 4cdae484ad9b14745b9ba043592358c400017e028061413b0cdbdbbf8eaf0209 Jun 11 16:59:21.714260 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.714229 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 16:59:21.717469 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.717434 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5"] Jun 11 16:59:21.723249 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:21.723210 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d88718d_3b18_408b_8ed9_aa9d067e3f36.slice/crio-bb85b66010be841c6e3feb282b38d02019c62496cc7a5a161976457b2a2aff41 WatchSource:0}: Error finding container bb85b66010be841c6e3feb282b38d02019c62496cc7a5a161976457b2a2aff41: Status 404 returned error can't find the container with id bb85b66010be841c6e3feb282b38d02019c62496cc7a5a161976457b2a2aff41 Jun 11 16:59:21.726659 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.725774 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:59:21.850119 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.849631 2579 patch_prober.go:28] interesting pod/image-registry-54c89d9f8-4xjkg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:59:21.850119 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:21.849692 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:59:22.258361 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.258223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:22.446444 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.445867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8rdp8" event={"ID":"6dcbecf2-400c-4722-9d1e-4c6996089564","Type":"ContainerStarted","Data":"ab8c6e09991bef1d9cebbe7f014ad10cdf3eee78795df12c91310a90e6d01029"} Jun 11 16:59:22.446444 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.446386 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:22.449728 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.449652 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7889f45b-gjs6l" event={"ID":"3d88718d-3b18-408b-8ed9-aa9d067e3f36","Type":"ContainerStarted","Data":"bb85b66010be841c6e3feb282b38d02019c62496cc7a5a161976457b2a2aff41"} Jun 11 16:59:22.452292 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.452224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" event={"ID":"d7444039-6ea0-49bb-a209-a9d509f863f2","Type":"ContainerStarted","Data":"1925e602c1008db64de66e23d741cf93bbc82482f27b642261a06714241ee26c"} Jun 11 16:59:22.455801 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.455671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" event={"ID":"a79b8154-a0f3-40f2-95b5-0b87790ffd14","Type":"ContainerStarted","Data":"318ce2d39ce0940e7c2814879be6667cb4ed27a70939ec4bdfa274d8382710fd"} Jun 11 16:59:22.455801 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.455726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" event={"ID":"a79b8154-a0f3-40f2-95b5-0b87790ffd14","Type":"ContainerStarted","Data":"17be5144fa0f734ee495cbbf67a4b8b7be7941d3475ddfd9b81fbd84b8272464"} Jun 11 16:59:22.455801 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.455755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" event={"ID":"a79b8154-a0f3-40f2-95b5-0b87790ffd14","Type":"ContainerStarted","Data":"1304e99705d6f091fcc68f9a18eace66a5b82ee006035772912c771a26db3cc6"} Jun 11 16:59:22.459241 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.459190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"4cdae484ad9b14745b9ba043592358c400017e028061413b0cdbdbbf8eaf0209"} Jun 11 16:59:22.462204 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.462110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"946ce95776b392cf5ba1f8c516cd12fe25b9260cd77841199c1b7d7b14af1e6f"} Jun 11 16:59:22.466270 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.465493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" event={"ID":"6298ea9d-7f14-4006-af6e-d6651136b199","Type":"ContainerStarted","Data":"88683fa237c4bab4e8553721758e844a66d44ca774a7892306926333e65b3f64"} Jun 11 16:59:22.472572 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.472324 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-8rdp8" Jun 11 16:59:22.491373 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:22.489681 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-8rdp8" podStartSLOduration=2.419573624 podStartE2EDuration="21.489656026s" totalImagesPullingTime="19.070082402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:22.464705983 +0000 UTC m=+284.441661661" watchObservedRunningTime="2026-06-11 16:59:22.489656026 +0000 UTC m=+284.466611704" Jun 11 16:59:23.065692 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:23.065614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:23.126892 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:23.126819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:24.529353 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:24.529290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:24.848924 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:24.848819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:24.851581 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:24.851552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c898b89f-feaf-41d1-8310-cd479dbef86f-metrics-tls\") pod \"dns-default-8jx4f\" (UID: \"c898b89f-feaf-41d1-8310-cd479dbef86f\") " pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:24.929896 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:24.929860 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9gb4\"" Jun 11 16:59:24.938390 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:24.938352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:25.612600 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:25.612568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:26.865100 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:26.865058 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" containerID="cri-o://93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034" gracePeriod=30 Jun 11 16:59:27.229333 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.229230 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.378837 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.378940 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.378982 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.379028 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6d6q\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.379057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.379085 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.379393 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.379139 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.382077 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.381640 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets\") pod \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\" (UID: \"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026\") " Jun 11 16:59:27.386200 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.386168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jx4f"] Jun 11 16:59:27.386534 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.386422 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:27.386589 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.386532 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:27.389583 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.389548 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q" (OuterVolumeSpecName: "kube-api-access-f6d6q") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "kube-api-access-f6d6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:27.389583 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.389573 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:27.389721 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.389551 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:27.389814 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.389791 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:27.390329 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.390301 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:27.407556 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.407512 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" (UID: "c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:59:27.421678 ip-10-0-133-82 kubenswrapper[2579]: W0611 16:59:27.421619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc898b89f_feaf_41d1_8310_cd479dbef86f.slice/crio-df3880e53a0e101f564b6811a48260fd45e175b35809ce3673d51680db94da08 WatchSource:0}: Error finding container df3880e53a0e101f564b6811a48260fd45e175b35809ce3673d51680db94da08: Status 404 returned error can't find the container with id df3880e53a0e101f564b6811a48260fd45e175b35809ce3673d51680db94da08 Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484279 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-certificates\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484308 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-registry-tls\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484324 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-image-registry-private-configuration\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484339 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6d6q\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-kube-api-access-f6d6q\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484354 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-bound-sa-token\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484368 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-ca-trust-extracted\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484381 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-trusted-ca\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.485698 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.484399 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026-installation-pull-secrets\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:27.509985 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.509869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zf5" event={"ID":"467875c9-bda8-4215-af83-5ffc7a2492ef","Type":"ContainerStarted","Data":"f1b41eb5987b4e9675a98aa98c9c58a45e62feb5e3f05144a16531b1fd729415"} Jun 11 16:59:27.512950 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.511697 2579 generic.go:356] "Generic (PLEG): container finished" podID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerID="93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034" exitCode=0 Jun 11 16:59:27.512950 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.511791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" event={"ID":"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026","Type":"ContainerDied","Data":"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034"} Jun 11 16:59:27.512950 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.511837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" event={"ID":"c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026","Type":"ContainerDied","Data":"5910c3b4684dca9ea1999f65177dc70bd3c6f95dc63249a6a93fe42622adfec6"} Jun 11 16:59:27.512950 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.511866 2579 scope.go:117] "RemoveContainer" containerID="93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034" Jun 11 16:59:27.512950 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.512032 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c89d9f8-4xjkg" Jun 11 16:59:27.517189 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.517138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jx4f" event={"ID":"c898b89f-feaf-41d1-8310-cd479dbef86f","Type":"ContainerStarted","Data":"df3880e53a0e101f564b6811a48260fd45e175b35809ce3673d51680db94da08"} Jun 11 16:59:27.555220 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.553374 2579 scope.go:117] "RemoveContainer" containerID="93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034" Jun 11 16:59:27.555800 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:27.555700 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034\": container with ID starting with 93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034 not found: ID does not exist" containerID="93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034" Jun 11 16:59:27.555800 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.555744 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034"} err="failed to get container status \"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034\": rpc error: code = NotFound desc = could not find container \"93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034\": container with ID starting with 93065ef86d1f2e59a9372dd06fa029b9e72c1bb4534f6224cc5635d4ce5d2034 not found: ID does not exist" Jun 11 16:59:27.588927 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.588882 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:59:27.593409 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:27.593388 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54c89d9f8-4xjkg"] Jun 11 16:59:28.509820 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.509444 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" path="/var/lib/kubelet/pods/c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026/volumes" Jun 11 16:59:28.524348 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.524310 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e" exitCode=0 Jun 11 16:59:28.524546 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.524416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e"} Jun 11 16:59:28.527365 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.527321 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" exitCode=0 Jun 11 16:59:28.527469 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.527412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} Jun 11 16:59:28.533286 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.533256 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" event={"ID":"6298ea9d-7f14-4006-af6e-d6651136b199","Type":"ContainerStarted","Data":"b1fb2a0433025fa4e0d646ee9d847a529e6aa3a43915c409c4ff62d0b62ee79d"} Jun 11 16:59:28.533402 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.533325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" event={"ID":"6298ea9d-7f14-4006-af6e-d6651136b199","Type":"ContainerStarted","Data":"8e171114ad18490952e395dddfe89a4046cef95a616ae0e82474aad28023ea58"} Jun 11 16:59:28.533402 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.533357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" event={"ID":"6298ea9d-7f14-4006-af6e-d6651136b199","Type":"ContainerStarted","Data":"028c0a222502fc4075dd7fd5183e8205bc89edbe9a67bdf4956036717886b611"} Jun 11 16:59:28.536021 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.535981 2579 generic.go:356] "Generic (PLEG): container finished" podID="467875c9-bda8-4215-af83-5ffc7a2492ef" containerID="f1b41eb5987b4e9675a98aa98c9c58a45e62feb5e3f05144a16531b1fd729415" exitCode=0 Jun 11 16:59:28.536400 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.536372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zf5" event={"ID":"467875c9-bda8-4215-af83-5ffc7a2492ef","Type":"ContainerDied","Data":"f1b41eb5987b4e9675a98aa98c9c58a45e62feb5e3f05144a16531b1fd729415"} Jun 11 16:59:28.541395 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.541362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7889f45b-gjs6l" event={"ID":"3d88718d-3b18-408b-8ed9-aa9d067e3f36","Type":"ContainerStarted","Data":"1eb366fab757b0be8cae1afb92c3bbff633070c5d13e32a356f1a108ed05fa0c"} Jun 11 16:59:28.543932 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.543561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" event={"ID":"d7444039-6ea0-49bb-a209-a9d509f863f2","Type":"ContainerStarted","Data":"8d1d2ec9e00ffe08b1782b26ef0eeed1d6f1d62d914117f71e836609ed4dda31"} Jun 11 16:59:28.543932 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.543673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:28.546986 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.546941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" event={"ID":"a79b8154-a0f3-40f2-95b5-0b87790ffd14","Type":"ContainerStarted","Data":"bc4f59b366d41ee3df595d4968f6e6239d6e85e66b7a4b924e8cded038715114"} Jun 11 16:59:28.551185 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.551131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" Jun 11 16:59:28.602575 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.602504 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-spsd6" podStartSLOduration=9.060730422 podStartE2EDuration="14.602488048s" totalImagesPullingTime="5.541757626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:28.601802146 +0000 UTC m=+290.578757826" watchObservedRunningTime="2026-06-11 16:59:28.602488048 +0000 UTC m=+290.579443726" Jun 11 16:59:28.620293 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.620225 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9cz64" podStartSLOduration=4.942952368 podStartE2EDuration="10.620208843s" totalImagesPullingTime="5.677256475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:28.619144741 +0000 UTC m=+290.596100420" watchObservedRunningTime="2026-06-11 16:59:28.620208843 +0000 UTC m=+290.597164520" Jun 11 16:59:28.644155 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.644010 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g4cr5" podStartSLOduration=9.21093412 podStartE2EDuration="14.643988034s" totalImagesPullingTime="5.433053914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:28.642354355 +0000 UTC m=+290.619310032" watchObservedRunningTime="2026-06-11 16:59:28.643988034 +0000 UTC m=+290.620943717" Jun 11 16:59:28.663096 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:28.662898 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7889f45b-gjs6l" podStartSLOduration=5.920197706 podStartE2EDuration="11.662872735s" totalImagesPullingTime="5.742675029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:28.66145072 +0000 UTC m=+290.638406421" watchObservedRunningTime="2026-06-11 16:59:28.662872735 +0000 UTC m=+290.639828411" Jun 11 16:59:29.554939 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:29.554842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zf5" event={"ID":"467875c9-bda8-4215-af83-5ffc7a2492ef","Type":"ContainerStarted","Data":"631bb386f233a5529abd544acafd784ed441031ce71499b3c3f39415c8404c57"} Jun 11 16:59:29.554939 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:29.554934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zf5" event={"ID":"467875c9-bda8-4215-af83-5ffc7a2492ef","Type":"ContainerStarted","Data":"05e39129fa60c644633fd39e4845be24d05094295c406041649a425100d17d0e"} Jun 11 16:59:29.577336 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:29.577270 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v5zf5" podStartSLOduration=9.660040268 podStartE2EDuration="15.57725532s" totalImagesPullingTime="5.763622094s" totalInitContainerRuntime="153.592958ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:29.57604303 +0000 UTC m=+291.552998727" watchObservedRunningTime="2026-06-11 16:59:29.57725532 +0000 UTC m=+291.554210997" Jun 11 16:59:30.561837 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:30.561798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jx4f" event={"ID":"c898b89f-feaf-41d1-8310-cd479dbef86f","Type":"ContainerStarted","Data":"398b5854b83fb318a691b3e108bcc595b3fa307d05f1eb397b8b5e925858eaf1"} Jun 11 16:59:30.562330 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:30.561859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jx4f" event={"ID":"c898b89f-feaf-41d1-8310-cd479dbef86f","Type":"ContainerStarted","Data":"535983f1f86074f4d467f4071b34b1b0fa5ad8c7ffad931776f3c250b5d1b194"} Jun 11 16:59:30.562330 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:30.562082 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:30.590204 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:30.590143 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8jx4f" podStartSLOduration=255.235879807 podStartE2EDuration="4m17.590125877s" totalImagesPullingTime="2.35424607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:30.589412096 +0000 UTC m=+292.566367772" watchObservedRunningTime="2026-06-11 16:59:30.590125877 +0000 UTC m=+292.567081572" Jun 11 16:59:31.291182 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:31.291144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:31.390620 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:31.390591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:31.569173 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:31.569138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf"} Jun 11 16:59:31.569544 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:31.569210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e"} Jun 11 16:59:33.076207 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.076177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:33.134785 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.134754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:33.438727 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.438678 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 16:59:33.553368 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.553336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:33.581110 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.581025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} Jun 11 16:59:33.581256 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.581114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} Jun 11 16:59:33.583821 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.583795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6"} Jun 11 16:59:33.583982 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.583854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e"} Jun 11 16:59:33.583982 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.583879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1"} Jun 11 16:59:33.653330 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.653288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:33.753750 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:33.753718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:34.591569 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:34.591528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerStarted","Data":"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1"} Jun 11 16:59:34.633275 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:34.633141 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.979574108 podStartE2EDuration="19.633120691s" totalImagesPullingTime="9.58378532s" totalInitContainerRuntime="69.761263ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:34.630684145 +0000 UTC m=+296.607639837" watchObservedRunningTime="2026-06-11 16:59:34.633120691 +0000 UTC m=+296.610076370" Jun 11 16:59:34.830054 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:34.830009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:34.902775 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:34.902701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:35.144284 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:35.144207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:35.212277 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:35.212195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:36.502280 ip-10-0-133-82 kubenswrapper[2579]: E0611 16:59:36.502237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gq2cz" podUID="ce3db5f5-7012-41e6-85cb-f2afb8af4224" Jun 11 16:59:36.603706 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:36.603672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} Jun 11 16:59:36.603867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:36.603741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} Jun 11 16:59:36.603867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:36.603767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} Jun 11 16:59:36.603867 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:36.603792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerStarted","Data":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} Jun 11 16:59:36.657955 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:36.657823 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.332926637 podStartE2EDuration="16.657807996s" totalImagesPullingTime="12.275885769s" totalInitContainerRuntime="48.99559ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:59:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:59:36.657773494 +0000 UTC m=+298.634729198" watchObservedRunningTime="2026-06-11 16:59:36.657807996 +0000 UTC m=+298.634763673" Jun 11 16:59:38.152432 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.152398 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:38.468476 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.468451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 16:59:38.468990 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.468969 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 16:59:38.474692 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.474671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:59:38.475449 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.475426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 16:59:38.478648 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:38.478631 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:59:40.571483 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:40.571450 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8jx4f" Jun 11 16:59:40.810406 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:40.810369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:59:42.146806 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:42.146767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:42.213305 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:42.213263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:47.167858 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:47.167816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:47.246323 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:47.246290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:48.522853 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:48.522816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:48.595459 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:48.595430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:50.501272 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:50.501236 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 16:59:57.244139 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:57.244109 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmlsv_662e86eb-499b-4a2f-bfb0-23bf36c01f7d/serve-healthcheck-canary/0.log" Jun 11 16:59:57.521753 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:57.521710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:57.620607 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:57.620575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:58.460247 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.460181 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c7889f45b-gjs6l" podUID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" containerName="console" containerID="cri-o://1eb366fab757b0be8cae1afb92c3bbff633070c5d13e32a356f1a108ed05fa0c" gracePeriod=15 Jun 11 16:59:58.692674 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.692642 2579 generic.go:356] "Generic (PLEG): container finished" podID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" containerID="1eb366fab757b0be8cae1afb92c3bbff633070c5d13e32a356f1a108ed05fa0c" exitCode=0 Jun 11 16:59:58.692842 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.692723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7889f45b-gjs6l" event={"ID":"3d88718d-3b18-408b-8ed9-aa9d067e3f36","Type":"ContainerDied","Data":"1eb366fab757b0be8cae1afb92c3bbff633070c5d13e32a356f1a108ed05fa0c"} Jun 11 16:59:58.744553 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.744523 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:58.891239 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891201 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891316 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891367 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891391 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpvkg\" (UniqueName: \"kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891430 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891430 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config\") pod \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\" (UID: \"3d88718d-3b18-408b-8ed9-aa9d067e3f36\") " Jun 11 16:59:58.891744 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891700 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:58.891957 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891804 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:58.892044 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891806 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:58.892044 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.891991 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config" (OuterVolumeSpecName: "console-config") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:59:58.893645 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.893625 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:58.893750 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.893647 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:59:58.893806 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.893751 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg" (OuterVolumeSpecName: "kube-api-access-wpvkg") pod "3d88718d-3b18-408b-8ed9-aa9d067e3f36" (UID: "3d88718d-3b18-408b-8ed9-aa9d067e3f36"). InnerVolumeSpecName "kube-api-access-wpvkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992112 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-oauth-serving-cert\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992146 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpvkg\" (UniqueName: \"kubernetes.io/projected/3d88718d-3b18-408b-8ed9-aa9d067e3f36-kube-api-access-wpvkg\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992162 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992174 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-service-ca\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992186 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-oauth-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992198 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d88718d-3b18-408b-8ed9-aa9d067e3f36-console-serving-cert\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:58.992210 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:58.992212 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d88718d-3b18-408b-8ed9-aa9d067e3f36-trusted-ca-bundle\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 16:59:59.699231 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:59.699198 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7889f45b-gjs6l" Jun 11 16:59:59.699231 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:59.699223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7889f45b-gjs6l" event={"ID":"3d88718d-3b18-408b-8ed9-aa9d067e3f36","Type":"ContainerDied","Data":"bb85b66010be841c6e3feb282b38d02019c62496cc7a5a161976457b2a2aff41"} Jun 11 16:59:59.699709 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:59.699277 2579 scope.go:117] "RemoveContainer" containerID="1eb366fab757b0be8cae1afb92c3bbff633070c5d13e32a356f1a108ed05fa0c" Jun 11 16:59:59.720425 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:59.720393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 16:59:59.725054 ip-10-0-133-82 kubenswrapper[2579]: I0611 16:59:59.725031 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7889f45b-gjs6l"] Jun 11 17:00:00.506385 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:00.506349 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" path="/var/lib/kubelet/pods/3d88718d-3b18-408b-8ed9-aa9d067e3f36/volumes" Jun 11 17:00:02.153134 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:02.153100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:02.252735 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:02.252692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:09.152204 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:09.152127 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:09.263082 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:09.263045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:09.369374 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:09.369338 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:20.809985 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:20.809937 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:20.829858 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:20.829829 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:21.803376 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:21.803345 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:33.580623 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:33.580544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:33.875627 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:33.875548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:34.591468 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.591417 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:34.593040 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.592994 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="alertmanager" containerID="cri-o://0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" gracePeriod=120 Jun 11 17:00:34.593040 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.593024 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="config-reloader" containerID="cri-o://6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" gracePeriod=120 Jun 11 17:00:34.593244 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.593042 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="prom-label-proxy" containerID="cri-o://3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" gracePeriod=120 Jun 11 17:00:34.593244 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.593082 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-metric" containerID="cri-o://0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" gracePeriod=120 Jun 11 17:00:34.593244 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.593042 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy" containerID="cri-o://cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" gracePeriod=120 Jun 11 17:00:34.593384 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.593260 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-web" containerID="cri-o://9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" gracePeriod=120 Jun 11 17:00:34.841189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841148 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" exitCode=0 Jun 11 17:00:34.841189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841177 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" exitCode=0 Jun 11 17:00:34.841189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841183 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" exitCode=0 Jun 11 17:00:34.841189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841189 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" exitCode=0 Jun 11 17:00:34.841434 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1"} Jun 11 17:00:34.841434 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e"} Jun 11 17:00:34.841434 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf"} Jun 11 17:00:34.841434 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:34.841345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e"} Jun 11 17:00:35.843658 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.843630 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:35.849210 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849180 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" exitCode=0 Jun 11 17:00:35.849210 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849207 2579 generic.go:356] "Generic (PLEG): container finished" podID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerID="9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" exitCode=0 Jun 11 17:00:35.849399 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849260 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:35.849399 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6"} Jun 11 17:00:35.849399 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1"} Jun 11 17:00:35.849399 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fa90fe3-45e6-47a1-8ee1-1415217100b0","Type":"ContainerDied","Data":"4cdae484ad9b14745b9ba043592358c400017e028061413b0cdbdbbf8eaf0209"} Jun 11 17:00:35.849544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.849414 2579 scope.go:117] "RemoveContainer" containerID="3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" Jun 11 17:00:35.859483 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.858041 2579 scope.go:117] "RemoveContainer" containerID="0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" Jun 11 17:00:35.868260 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.868239 2579 scope.go:117] "RemoveContainer" containerID="cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" Jun 11 17:00:35.877384 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.877364 2579 scope.go:117] "RemoveContainer" containerID="9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" Jun 11 17:00:35.887044 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.887019 2579 scope.go:117] "RemoveContainer" containerID="6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" Jun 11 17:00:35.896008 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.895972 2579 scope.go:117] "RemoveContainer" containerID="0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" Jun 11 17:00:35.899405 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899382 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899524 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899427 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899524 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899456 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899524 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899501 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899526 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899550 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899603 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmb9q\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899634 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899663 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899695 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899725 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899790 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899816 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle\") pod \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\" (UID: \"3fa90fe3-45e6-47a1-8ee1-1415217100b0\") " Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899823 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:35.899928 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.899851 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:00:35.900285 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.900262 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-metrics-client-ca\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:35.900361 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.900291 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-main-db\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:35.900473 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.900452 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:35.904238 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.904192 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out" (OuterVolumeSpecName: "config-out") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:00:35.905128 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.905095 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.905249 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.905226 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume" (OuterVolumeSpecName: "config-volume") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.905369 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.905350 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q" (OuterVolumeSpecName: "kube-api-access-tmb9q") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "kube-api-access-tmb9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:35.905369 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.905352 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.905874 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.905835 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.906347 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.906318 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.907174 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.907112 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:35.907271 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.907178 2579 scope.go:117] "RemoveContainer" containerID="45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e" Jun 11 17:00:35.908889 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.908868 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.916178 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.916147 2579 scope.go:117] "RemoveContainer" containerID="3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" Jun 11 17:00:35.916469 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.916451 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1\": container with ID starting with 3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1 not found: ID does not exist" containerID="3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" Jun 11 17:00:35.916543 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.916484 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1"} err="failed to get container status \"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1\": rpc error: code = NotFound desc = could not find container \"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1\": container with ID starting with 3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1 not found: ID does not exist" Jun 11 17:00:35.916543 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.916513 2579 scope.go:117] "RemoveContainer" containerID="0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" Jun 11 17:00:35.916858 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.916840 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6\": container with ID starting with 0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6 not found: ID does not exist" containerID="0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" Jun 11 17:00:35.916951 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.916867 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6"} err="failed to get container status \"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6\": rpc error: code = NotFound desc = could not find container \"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6\": container with ID starting with 0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6 not found: ID does not exist" Jun 11 17:00:35.916951 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.916889 2579 scope.go:117] "RemoveContainer" containerID="cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" Jun 11 17:00:35.917167 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.917148 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e\": container with ID starting with cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e not found: ID does not exist" containerID="cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" Jun 11 17:00:35.917244 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917173 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e"} err="failed to get container status \"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e\": rpc error: code = NotFound desc = could not find container \"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e\": container with ID starting with cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e not found: ID does not exist" Jun 11 17:00:35.917244 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917191 2579 scope.go:117] "RemoveContainer" containerID="9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" Jun 11 17:00:35.917439 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.917412 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1\": container with ID starting with 9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1 not found: ID does not exist" containerID="9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" Jun 11 17:00:35.917478 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917450 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1"} err="failed to get container status \"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1\": rpc error: code = NotFound desc = could not find container \"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1\": container with ID starting with 9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1 not found: ID does not exist" Jun 11 17:00:35.917478 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917472 2579 scope.go:117] "RemoveContainer" containerID="6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" Jun 11 17:00:35.917708 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.917691 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf\": container with ID starting with 6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf not found: ID does not exist" containerID="6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" Jun 11 17:00:35.917770 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917715 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf"} err="failed to get container status \"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf\": rpc error: code = NotFound desc = could not find container \"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf\": container with ID starting with 6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf not found: ID does not exist" Jun 11 17:00:35.917770 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.917735 2579 scope.go:117] "RemoveContainer" containerID="0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" Jun 11 17:00:35.918039 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.918020 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e\": container with ID starting with 0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e not found: ID does not exist" containerID="0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" Jun 11 17:00:35.918113 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918045 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e"} err="failed to get container status \"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e\": rpc error: code = NotFound desc = could not find container \"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e\": container with ID starting with 0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e not found: ID does not exist" Jun 11 17:00:35.918113 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918066 2579 scope.go:117] "RemoveContainer" containerID="45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e" Jun 11 17:00:35.918197 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918125 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config" (OuterVolumeSpecName: "web-config") pod "3fa90fe3-45e6-47a1-8ee1-1415217100b0" (UID: "3fa90fe3-45e6-47a1-8ee1-1415217100b0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:35.918300 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:35.918281 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e\": container with ID starting with 45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e not found: ID does not exist" containerID="45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e" Jun 11 17:00:35.918346 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918305 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e"} err="failed to get container status \"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e\": rpc error: code = NotFound desc = could not find container \"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e\": container with ID starting with 45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e not found: ID does not exist" Jun 11 17:00:35.918346 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918319 2579 scope.go:117] "RemoveContainer" containerID="3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1" Jun 11 17:00:35.918552 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918525 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1"} err="failed to get container status \"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1\": rpc error: code = NotFound desc = could not find container \"3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1\": container with ID starting with 3f71ee840bf471378f55224bd75bd807b31b1d61219f622f9aa265976d158ef1 not found: ID does not exist" Jun 11 17:00:35.918603 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918556 2579 scope.go:117] "RemoveContainer" containerID="0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6" Jun 11 17:00:35.918811 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918790 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6"} err="failed to get container status \"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6\": rpc error: code = NotFound desc = could not find container \"0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6\": container with ID starting with 0ab25aba85b7c90f3ab6050c5422508198742a29cb89f978dfe806e115008bd6 not found: ID does not exist" Jun 11 17:00:35.918876 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.918811 2579 scope.go:117] "RemoveContainer" containerID="cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e" Jun 11 17:00:35.919085 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919066 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e"} err="failed to get container status \"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e\": rpc error: code = NotFound desc = could not find container \"cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e\": container with ID starting with cdbea6ce32b9dc0b4495eb3e8ef7b9b28295abb7d47662c5d16db90e8084c17e not found: ID does not exist" Jun 11 17:00:35.919085 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919084 2579 scope.go:117] "RemoveContainer" containerID="9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1" Jun 11 17:00:35.919333 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919312 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1"} err="failed to get container status \"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1\": rpc error: code = NotFound desc = could not find container \"9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1\": container with ID starting with 9a7f26b467e7f77658d1f784c7dd122b788c22c8b6ed2bff1bce6342d49a60c1 not found: ID does not exist" Jun 11 17:00:35.919387 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919335 2579 scope.go:117] "RemoveContainer" containerID="6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf" Jun 11 17:00:35.919577 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919556 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf"} err="failed to get container status \"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf\": rpc error: code = NotFound desc = could not find container \"6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf\": container with ID starting with 6031a623a0b9b0db114612af587082f3e753ea984d9564881068d6c7fe811baf not found: ID does not exist" Jun 11 17:00:35.919643 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919580 2579 scope.go:117] "RemoveContainer" containerID="0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e" Jun 11 17:00:35.919834 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919806 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e"} err="failed to get container status \"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e\": rpc error: code = NotFound desc = could not find container \"0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e\": container with ID starting with 0e49341a76e5038a336b4acc30fdbd55caebd7e6d1b453f417468b1433c76c5e not found: ID does not exist" Jun 11 17:00:35.919834 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.919831 2579 scope.go:117] "RemoveContainer" containerID="45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e" Jun 11 17:00:35.920086 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:35.920062 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e"} err="failed to get container status \"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e\": rpc error: code = NotFound desc = could not find container \"45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e\": container with ID starting with 45e9c0ccec5f94f4310eed73eaf556482886bbe30fc31ab03cde22d6335ffe0e not found: ID does not exist" Jun 11 17:00:36.000979 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.000950 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.000979 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.000978 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.000991 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001000 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-cluster-tls-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001009 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmb9q\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-kube-api-access-tmb9q\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001018 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-out\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001026 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-web-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001034 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-config-volume\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001041 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fa90fe3-45e6-47a1-8ee1-1415217100b0-secret-alertmanager-main-tls\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001051 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fa90fe3-45e6-47a1-8ee1-1415217100b0-tls-assets\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.001165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.001059 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fa90fe3-45e6-47a1-8ee1-1415217100b0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:36.174335 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.174303 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:36.180584 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.180560 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:36.206206 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:36.206493 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206481 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="init-config-reloader" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206495 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="init-config-reloader" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206506 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-web" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206511 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-web" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206520 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206526 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206532 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" containerName="console" Jun 11 17:00:36.206540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206537 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" containerName="console" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206548 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-metric" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206554 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-metric" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206561 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="alertmanager" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206566 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="alertmanager" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206577 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206582 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206591 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="config-reloader" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206595 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="config-reloader" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206601 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="prom-label-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206606 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="prom-label-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206654 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-web" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206662 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="config-reloader" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206668 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d88718d-3b18-408b-8ed9-aa9d067e3f36" containerName="console" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206674 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="alertmanager" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206680 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c67b7a5f-4dd4-4d62-8c57-2c4f59e1d026" containerName="registry" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206685 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206690 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="prom-label-proxy" Jun 11 17:00:36.206739 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.206695 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" containerName="kube-rbac-proxy-metric" Jun 11 17:00:36.211488 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.211463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.213948 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.213975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gk8gh\"" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.213992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.214012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.214094 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 17:00:36.213971 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.213948 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 17:00:36.214485 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.214099 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 17:00:36.214485 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.214234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 17:00:36.214923 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.214886 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 17:00:36.219119 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.219102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 17:00:36.225362 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.225338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:36.303680 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303680 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303680 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.303995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.303980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.304257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.304012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbq8h\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-kube-api-access-gbq8h\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.304257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.304067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.304257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.304112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.304257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.304136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405372 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405372 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbq8h\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-kube-api-access-gbq8h\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.405850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.405826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.407789 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.406972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.407789 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.407110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.407789 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.407713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.408884 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.408701 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.408884 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.408815 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.408884 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.408864 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.409127 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.408972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.409127 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.408972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.409127 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.409040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.409461 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.409436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.410033 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.410017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.410249 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.410232 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.414020 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.414003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbq8h\" (UniqueName: \"kubernetes.io/projected/0a8ea93a-7cdd-4b8e-b586-7be34fe7f628-kube-api-access-gbq8h\") pod \"alertmanager-main-0\" (UID: \"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.506650 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.506615 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa90fe3-45e6-47a1-8ee1-1415217100b0" path="/var/lib/kubelet/pods/3fa90fe3-45e6-47a1-8ee1-1415217100b0/volumes" Jun 11 17:00:36.521432 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.521404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 17:00:36.663453 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.663417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 17:00:36.665989 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:00:36.665957 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8ea93a_7cdd_4b8e_b586_7be34fe7f628.slice/crio-d5c2e81eeb8c8837dc512fd3f580fbe2354c31be1fdb2ecdae22f81fbab19455 WatchSource:0}: Error finding container d5c2e81eeb8c8837dc512fd3f580fbe2354c31be1fdb2ecdae22f81fbab19455: Status 404 returned error can't find the container with id d5c2e81eeb8c8837dc512fd3f580fbe2354c31be1fdb2ecdae22f81fbab19455 Jun 11 17:00:36.855358 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.855268 2579 generic.go:356] "Generic (PLEG): container finished" podID="0a8ea93a-7cdd-4b8e-b586-7be34fe7f628" containerID="0d6385bb790423cbb2ae9b74c02134495dcc21b9f8cba3e1f0629158469b2c67" exitCode=0 Jun 11 17:00:36.855783 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.855349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerDied","Data":"0d6385bb790423cbb2ae9b74c02134495dcc21b9f8cba3e1f0629158469b2c67"} Jun 11 17:00:36.855783 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:36.855439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"d5c2e81eeb8c8837dc512fd3f580fbe2354c31be1fdb2ecdae22f81fbab19455"} Jun 11 17:00:37.864737 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"cd0b6b69eb8e427da5cf13a4360529f97e20b8e95bc706c5fd99e3fc23440fed"} Jun 11 17:00:37.865131 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"21c54820ea5c5855f305c5c763ed6eddc3e7ce72f5973dd7972654a2f865221a"} Jun 11 17:00:37.865131 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"83590a47215c00f18897cdd218d20dd7cd6e2f33a2c1a7fdd3395796f2de5d95"} Jun 11 17:00:37.865131 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"4836bf69ef0d5d104b2f2fa07008a4eca5ba123a4ae577e18ee8ba01ff542f84"} Jun 11 17:00:37.865131 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864856 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"fcc6787d1f433c49b88fc417404fc2fea9ab0b88d9a79a1153ea8a22245a7f49"} Jun 11 17:00:37.865131 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.864886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8ea93a-7cdd-4b8e-b586-7be34fe7f628","Type":"ContainerStarted","Data":"7bdbdbd2636f65267d006e2a45ef0cbc7ea55371e05b00df8c94d138464fde23"} Jun 11 17:00:37.892025 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:37.891975 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.874449681 podStartE2EDuration="1.89195889s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.509209ms" isStatefulPod=false podCreationTimestamp="2026-06-11 17:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:37.891278858 +0000 UTC m=+359.868234567" watchObservedRunningTime="2026-06-11 17:00:37.89195889 +0000 UTC m=+359.868914587" Jun 11 17:00:38.673881 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.673840 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-589ddbd944-tr5vm"] Jun 11 17:00:38.677166 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.677143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.679872 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.679815 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 17:00:38.680406 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.680384 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 17:00:38.680690 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.680384 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 17:00:38.680898 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.680426 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 17:00:38.680898 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.680476 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tcmwg\"" Jun 11 17:00:38.681492 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.681474 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 17:00:38.685887 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.685862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 17:00:38.694395 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.694373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-589ddbd944-tr5vm"] Jun 11 17:00:38.725410 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-federate-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725410 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-metrics-client-ca\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725593 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2589\" (UniqueName: \"kubernetes.io/projected/62c307d3-4c76-4d49-965f-f3ed0165e19e-kube-api-access-h2589\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725593 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-serving-certs-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725593 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725726 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725726 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.725726 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.725693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826331 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2589\" (UniqueName: \"kubernetes.io/projected/62c307d3-4c76-4d49-965f-f3ed0165e19e-kube-api-access-h2589\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-serving-certs-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826658 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826658 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826785 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-federate-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.826785 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.826724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-metrics-client-ca\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.827269 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.827235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-serving-certs-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.827476 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.827453 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-metrics-client-ca\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.827625 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.827540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.829488 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.829428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.829601 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.829572 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-secret-telemeter-client\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.830048 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.830026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-telemeter-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.830224 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.830206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/62c307d3-4c76-4d49-965f-f3ed0165e19e-federate-client-tls\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.835508 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.835484 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2589\" (UniqueName: \"kubernetes.io/projected/62c307d3-4c76-4d49-965f-f3ed0165e19e-kube-api-access-h2589\") pod \"telemeter-client-589ddbd944-tr5vm\" (UID: \"62c307d3-4c76-4d49-965f-f3ed0165e19e\") " pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:38.979830 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.979732 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:38.980296 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980130 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="prometheus" containerID="cri-o://e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" gracePeriod=600 Jun 11 17:00:38.980551 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980517 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-thanos" containerID="cri-o://abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" gracePeriod=600 Jun 11 17:00:38.980686 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980644 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy" containerID="cri-o://3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" gracePeriod=600 Jun 11 17:00:38.980758 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980720 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-web" containerID="cri-o://b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" gracePeriod=600 Jun 11 17:00:38.980821 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980804 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="thanos-sidecar" containerID="cri-o://d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" gracePeriod=600 Jun 11 17:00:38.980892 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.980877 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="config-reloader" containerID="cri-o://95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" gracePeriod=600 Jun 11 17:00:38.990365 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:38.990329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" Jun 11 17:00:39.185646 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.185567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-589ddbd944-tr5vm"] Jun 11 17:00:39.188462 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:00:39.188434 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c307d3_4c76_4d49_965f_f3ed0165e19e.slice/crio-def42e66c1df5e285ae0688e58f1bd15b9a386cb435bd8e230cc03915d3cd2fe WatchSource:0}: Error finding container def42e66c1df5e285ae0688e58f1bd15b9a386cb435bd8e230cc03915d3cd2fe: Status 404 returned error can't find the container with id def42e66c1df5e285ae0688e58f1bd15b9a386cb435bd8e230cc03915d3cd2fe Jun 11 17:00:39.190615 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.190589 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:00:39.251537 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.251512 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:39.333865 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.333837 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.333877 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.333926 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.333961 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334002 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334029 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334060 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334092 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334122 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334169 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng5rv\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334196 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334223 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334250 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334278 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334313 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334347 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334378 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334411 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334794 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334482 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.334794 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334512 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1\") pod \"0c5e1a37-4681-4848-bed3-95760b63dd75\" (UID: \"0c5e1a37-4681-4848-bed3-95760b63dd75\") " Jun 11 17:00:39.337167 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334218 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.337167 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.334998 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.337167 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.336967 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.337167 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.335156 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.337167 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.335486 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.337630 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.337401 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:39.338004 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.337971 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.338185 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338081 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.338185 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338094 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:00:39.338185 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338150 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.338185 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338161 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out" (OuterVolumeSpecName: "config-out") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:00:39.338472 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338335 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:00:39.338742 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338711 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.338825 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.338737 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.339325 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.339297 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.339435 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.339363 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.339579 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.339559 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config" (OuterVolumeSpecName: "config") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.339579 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.339568 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv" (OuterVolumeSpecName: "kube-api-access-ng5rv") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "kube-api-access-ng5rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:39.340874 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.340843 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.353271 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.353213 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config" (OuterVolumeSpecName: "web-config") pod "0c5e1a37-4681-4848-bed3-95760b63dd75" (UID: "0c5e1a37-4681-4848-bed3-95760b63dd75"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:00:39.435803 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435772 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-metrics-client-ca\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.435803 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435801 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-metrics-client-certs\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.435803 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435811 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435819 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-config-out\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435828 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435838 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435847 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-tls-assets\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435855 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-web-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435863 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435872 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng5rv\" (UniqueName: \"kubernetes.io/projected/0c5e1a37-4681-4848-bed3-95760b63dd75-kube-api-access-ng5rv\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435881 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435890 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-config\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435897 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-db\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435930 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-grpc-tls\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435940 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435948 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435957 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435966 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435974 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c5e1a37-4681-4848-bed3-95760b63dd75-secret-kube-rbac-proxy\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.436049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.435982 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c5e1a37-4681-4848-bed3-95760b63dd75-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:00:39.556134 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.556102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:39.624903 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.624870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875109 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" exitCode=0 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875134 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" exitCode=0 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875140 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" exitCode=0 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875146 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" exitCode=0 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875151 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" exitCode=0 Jun 11 17:00:39.875144 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875158 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" exitCode=0 Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875194 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875326 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} Jun 11 17:00:39.875568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.875470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c5e1a37-4681-4848-bed3-95760b63dd75","Type":"ContainerDied","Data":"946ce95776b392cf5ba1f8c516cd12fe25b9260cd77841199c1b7d7b14af1e6f"} Jun 11 17:00:39.877049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.876648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" event={"ID":"62c307d3-4c76-4d49-965f-f3ed0165e19e","Type":"ContainerStarted","Data":"def42e66c1df5e285ae0688e58f1bd15b9a386cb435bd8e230cc03915d3cd2fe"} Jun 11 17:00:39.883529 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.883509 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.890447 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.890428 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.896897 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.896878 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.903841 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.903817 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:39.904344 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.904328 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.911363 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.911343 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:39.911799 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.911779 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.919029 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.919003 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.925572 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.925555 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.925817 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.925799 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.925861 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.925826 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.925861 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.925844 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.926113 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.926093 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.926168 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926118 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.926168 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926135 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.926368 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.926349 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.926422 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926374 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.926422 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926391 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.926645 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.926629 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.926683 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926649 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.926683 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926671 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.926896 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.926881 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.926991 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926901 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.926991 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.926952 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.927223 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.927208 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.927268 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927226 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.927268 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927249 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.927461 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:00:39.927444 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.927495 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927465 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.927495 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927477 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.927690 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927672 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.927735 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927690 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.927887 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927868 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.927975 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.927890 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.928112 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928095 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.928154 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928112 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.928323 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928304 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.928393 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928325 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.928533 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928516 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.928578 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928533 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.928720 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928703 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.928761 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928720 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.928879 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928857 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.928948 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.928880 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.929085 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929067 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.929158 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929086 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.929276 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929258 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.929317 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929276 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.929462 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929443 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.929531 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929463 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.929670 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929653 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.929714 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929671 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.929946 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929900 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.930022 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.929948 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.930209 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930192 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.930254 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930209 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.930418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930394 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.930466 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930421 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.930657 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930640 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.930657 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930657 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.930879 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930861 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.930972 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.930881 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.931117 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931099 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.931162 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931118 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.931351 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931332 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.931403 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931351 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.931553 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931538 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.931605 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931554 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.931752 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931737 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.931789 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931752 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.931935 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931903 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.931979 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.931939 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.932139 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932121 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.932211 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932141 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.932361 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932345 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.932406 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932361 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.932529 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932511 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.932569 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932530 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.932741 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932725 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.932812 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932743 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.933007 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.932984 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.933007 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933002 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.933191 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933167 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.933233 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933193 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.933369 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933352 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.933413 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933368 2579 scope.go:117] "RemoveContainer" containerID="abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed" Jun 11 17:00:39.933540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933524 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed"} err="failed to get container status \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": rpc error: code = NotFound desc = could not find container \"abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed\": container with ID starting with abc0d0654b819dfbeb993742a92cedc03c1f6ba5c9d3c42da5dc7c30529dcaed not found: ID does not exist" Jun 11 17:00:39.933580 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933541 2579 scope.go:117] "RemoveContainer" containerID="3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b" Jun 11 17:00:39.933758 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933740 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b"} err="failed to get container status \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": rpc error: code = NotFound desc = could not find container \"3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b\": container with ID starting with 3a61d511168e2baafcf0ad6fb9927902b3e4838dc898ed64d1fd0d9f75c2a62b not found: ID does not exist" Jun 11 17:00:39.933805 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933759 2579 scope.go:117] "RemoveContainer" containerID="b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b" Jun 11 17:00:39.934008 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.933985 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b"} err="failed to get container status \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": rpc error: code = NotFound desc = could not find container \"b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b\": container with ID starting with b0403267c3f98d56d7cc2f755031903681beef138e270e7ce52530679a4bab2b not found: ID does not exist" Jun 11 17:00:39.934008 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934005 2579 scope.go:117] "RemoveContainer" containerID="d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b" Jun 11 17:00:39.934379 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934352 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b"} err="failed to get container status \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": rpc error: code = NotFound desc = could not find container \"d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b\": container with ID starting with d7bff59c6331e0fcad23bf54c6cdba5338106e0b53241250719ccc7b0aeae19b not found: ID does not exist" Jun 11 17:00:39.934379 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934374 2579 scope.go:117] "RemoveContainer" containerID="95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1" Jun 11 17:00:39.934652 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934623 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1"} err="failed to get container status \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": rpc error: code = NotFound desc = could not find container \"95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1\": container with ID starting with 95c4ba7cc02eb9fbae821e7c5060cc640f6758ab63d0e977a8a9021a308f4cf1 not found: ID does not exist" Jun 11 17:00:39.934652 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934649 2579 scope.go:117] "RemoveContainer" containerID="e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097" Jun 11 17:00:39.934956 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934934 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097"} err="failed to get container status \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": rpc error: code = NotFound desc = could not find container \"e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097\": container with ID starting with e7f4927ed7a632487d66e01ed94d8e7fe3b7f60c9771eddb7462dc9d4293a097 not found: ID does not exist" Jun 11 17:00:39.934956 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.934956 2579 scope.go:117] "RemoveContainer" containerID="935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696" Jun 11 17:00:39.935191 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.935175 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696"} err="failed to get container status \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": rpc error: code = NotFound desc = could not find container \"935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696\": container with ID starting with 935b46a9a0a86661aed609b1e939c2f71484a1647d084ad31faeebd031e3f696 not found: ID does not exist" Jun 11 17:00:39.946126 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946096 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:39.946406 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946394 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-web" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946408 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-web" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946420 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="config-reloader" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946426 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="config-reloader" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946432 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946437 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy" Jun 11 17:00:39.946446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946444 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-thanos" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946450 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-thanos" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946464 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="prometheus" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946469 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="prometheus" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946475 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="thanos-sidecar" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946480 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="thanos-sidecar" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946488 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="init-config-reloader" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946493 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="init-config-reloader" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946552 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="prometheus" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946559 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-web" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946565 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946574 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="config-reloader" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946579 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="thanos-sidecar" Jun 11 17:00:39.946641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.946586 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" containerName="kube-rbac-proxy-thanos" Jun 11 17:00:39.954442 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.954419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:39.957724 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.957690 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 17:00:39.957841 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.957823 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 17:00:39.958009 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.957995 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 17:00:39.958074 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 17:00:39.958539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958521 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 17:00:39.958539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9a01ipheu0el7\"" Jun 11 17:00:39.958539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958540 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 17:00:39.958746 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958529 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 17:00:39.958746 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 17:00:39.958880 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958864 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 17:00:39.958941 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.958893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 17:00:39.959126 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.959113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 17:00:39.959456 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.959433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrd5s\"" Jun 11 17:00:39.959682 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.959650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 17:00:39.959996 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.959976 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 17:00:39.962705 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.962686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 17:00:39.964184 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.964166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 17:00:39.974888 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:39.974865 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:40.041206 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041206 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.041713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsk4w\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-kube-api-access-wsk4w\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.042300 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.042300 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.041783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.142716 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.142716 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.142716 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.142716 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsk4w\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-kube-api-access-wsk4w\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.142962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143544 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143885 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.143885 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.143706 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.145197 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.144235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.145197 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.144650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.145197 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.144823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.147940 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.147760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148114 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148114 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148234 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148509 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148481 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148588 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148707 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148707 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148609 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148814 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148872 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148859 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.148945 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.148894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.149361 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.149341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.149684 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.149669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-config\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.152468 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.152448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsk4w\" (UniqueName: \"kubernetes.io/projected/9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1-kube-api-access-wsk4w\") pod \"prometheus-k8s-0\" (UID: \"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.264684 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.264637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:40.415109 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.415023 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 17:00:40.417875 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:00:40.417850 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa63ad5_417f_45c4_a6fa_3d5eb1d07bf1.slice/crio-cf409e6e4f5a4a8e5756331f6f85ef761292f3def8bc768affdd4c6a9060ed81 WatchSource:0}: Error finding container cf409e6e4f5a4a8e5756331f6f85ef761292f3def8bc768affdd4c6a9060ed81: Status 404 returned error can't find the container with id cf409e6e4f5a4a8e5756331f6f85ef761292f3def8bc768affdd4c6a9060ed81 Jun 11 17:00:40.507885 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.507810 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5e1a37-4681-4848-bed3-95760b63dd75" path="/var/lib/kubelet/pods/0c5e1a37-4681-4848-bed3-95760b63dd75/volumes" Jun 11 17:00:40.884337 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.884302 2579 generic.go:356] "Generic (PLEG): container finished" podID="9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1" containerID="510f167d89fe14835d40cd90d67878e86c89d17446da2d99f743d3293bfbaa6f" exitCode=0 Jun 11 17:00:40.884539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.884392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerDied","Data":"510f167d89fe14835d40cd90d67878e86c89d17446da2d99f743d3293bfbaa6f"} Jun 11 17:00:40.884539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:40.884476 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"cf409e6e4f5a4a8e5756331f6f85ef761292f3def8bc768affdd4c6a9060ed81"} Jun 11 17:00:41.891665 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"34bd83197acbb329df850c26698b84cf70763413d5364c90f887a601f40fb1d7"} Jun 11 17:00:41.892118 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"e53d414924664490061ee4d25805f55837de831a52b7fe9ef34cb182a4f4a9d8"} Jun 11 17:00:41.892118 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"748b670d7ec6bd6090c5f3bc3f5c7d55588c872bae0605dbd6709653dd98f06a"} Jun 11 17:00:41.892118 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"b9f1247b03847198437bce733870996df6d1fa3b0f89f99cfebce483223d22e0"} Jun 11 17:00:41.892118 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"c71939993244594780f01bc4ce8c0a5f531128d9dfca79bc5fd46c044f6f5e41"} Jun 11 17:00:41.892118 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.891869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1","Type":"ContainerStarted","Data":"1d09a80403f78bdb75d93bbeb4f16625dda3d7160e348995c68103e74fc46678"} Jun 11 17:00:41.893621 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.893600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" event={"ID":"62c307d3-4c76-4d49-965f-f3ed0165e19e","Type":"ContainerStarted","Data":"fb8d5d19c36d014a59a81a9b6994488311d0c9c045f5d82d5a45f0f6aa21c9e7"} Jun 11 17:00:41.893668 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.893651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" event={"ID":"62c307d3-4c76-4d49-965f-f3ed0165e19e","Type":"ContainerStarted","Data":"bd010421800880a174100cb2e23825df67171bf616f3506313381424a4a96667"} Jun 11 17:00:41.893698 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.893670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" event={"ID":"62c307d3-4c76-4d49-965f-f3ed0165e19e","Type":"ContainerStarted","Data":"08d88b8b767659e3aa1dc63a1ffbb9794f52c7e50a4e14cbd9750f398a0022b1"} Jun 11 17:00:41.926456 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.926406 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.901430465 podStartE2EDuration="2.926388847s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.958382ms" isStatefulPod=false podCreationTimestamp="2026-06-11 17:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:41.924059816 +0000 UTC m=+363.901015492" watchObservedRunningTime="2026-06-11 17:00:41.926388847 +0000 UTC m=+363.903344526" Jun 11 17:00:41.948597 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:41.948495 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-589ddbd944-tr5vm" podStartSLOduration=1.6581189269999999 podStartE2EDuration="3.948476612s" totalImagesPullingTime="2.290357685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:41.94680143 +0000 UTC m=+363.923757120" watchObservedRunningTime="2026-06-11 17:00:41.948476612 +0000 UTC m=+363.925432288" Jun 11 17:00:42.838770 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:42.838601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:42.938082 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:42.938052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:43.038568 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:43.038518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:43.520976 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:43.520938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:43.577871 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:43.577823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:45.265751 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:45.265711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:00:51.455021 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.454983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 17:00:51.457300 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.457280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce3db5f5-7012-41e6-85cb-f2afb8af4224-metrics-certs\") pod \"network-metrics-daemon-gq2cz\" (UID: \"ce3db5f5-7012-41e6-85cb-f2afb8af4224\") " pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 17:00:51.704712 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.704678 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxj6x\"" Jun 11 17:00:51.713227 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.713171 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gq2cz" Jun 11 17:00:51.856893 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.856863 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gq2cz"] Jun 11 17:00:51.859556 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:00:51.859526 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3db5f5_7012_41e6_85cb_f2afb8af4224.slice/crio-fbdfaedced79c5ede8d6e3ab8d8ddf5330f98cb48b7608e03e7c4f32c4473a17 WatchSource:0}: Error finding container fbdfaedced79c5ede8d6e3ab8d8ddf5330f98cb48b7608e03e7c4f32c4473a17: Status 404 returned error can't find the container with id fbdfaedced79c5ede8d6e3ab8d8ddf5330f98cb48b7608e03e7c4f32c4473a17 Jun 11 17:00:51.941659 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:51.941621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gq2cz" event={"ID":"ce3db5f5-7012-41e6-85cb-f2afb8af4224","Type":"ContainerStarted","Data":"fbdfaedced79c5ede8d6e3ab8d8ddf5330f98cb48b7608e03e7c4f32c4473a17"} Jun 11 17:00:52.947090 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:52.947060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gq2cz" event={"ID":"ce3db5f5-7012-41e6-85cb-f2afb8af4224","Type":"ContainerStarted","Data":"77cb8fcde99b8140e2796259d1a184e6bbe28a3e93c4ddc10b4357d2aca6204e"} Jun 11 17:00:53.907635 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:53.907595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:53.952423 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:53.952386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gq2cz" event={"ID":"ce3db5f5-7012-41e6-85cb-f2afb8af4224","Type":"ContainerStarted","Data":"56a426fda06a0b5145d631992cc2dec7708b49151b9a6951fd7e1aa592a6f092"} Jun 11 17:00:53.974927 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:53.974860 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gq2cz" podStartSLOduration=375.061732671 podStartE2EDuration="6m15.974842028s" totalImagesPullingTime="913.109357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:53.972733639 +0000 UTC m=+375.949689316" watchObservedRunningTime="2026-06-11 17:00:53.974842028 +0000 UTC m=+375.951797731" Jun 11 17:00:53.977888 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:53.977863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:54.052125 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:54.052087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:54.156456 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:54.156415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:54.219437 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:00:54.219362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:27.346061 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:27.346025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:27.448721 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:27.448685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:40.265535 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:40.265494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:01:40.281212 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:40.281185 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:01:41.158310 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:41.158283 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 17:01:42.730065 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:42.730028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:48.832659 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:48.832625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:48.941509 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:48.941477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:51.316178 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:51.316144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:51.392284 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:01:51.392250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:00.761228 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:00.761148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:00.869091 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:00.869053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:02.174514 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:02.174480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:02.273606 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:02.273570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:02.352440 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:02.352402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:17.168231 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:17.168194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:17.268041 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:17.268009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:17.550121 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:17.550082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:26.877995 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:26.877958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:26.979339 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:26.979309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:29.290020 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:29.289990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:29.390641 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:29.390607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:59.914528 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:02:59.914480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:00.008483 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:00.008454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:29.394615 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:29.394544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:29.494848 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:29.494813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:44.323507 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:44.323461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:44.650311 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:44.650214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:48.139550 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:48.139513 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:48.257177 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:48.257140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:49.668106 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:49.668074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:49.821408 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:49.821376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:49.970004 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:49.969918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:50.092257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:50.092226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:53.128724 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:53.128687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:53.276526 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:53.276490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:54.917306 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:54.917268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:54.993797 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:54.993761 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dpjln"] Jun 11 17:03:54.997117 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:54.997089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:54.998689 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:54.998660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:55.001715 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.001698 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nwnfn\"" Jun 11 17:03:55.002483 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.002464 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 17:03:55.002847 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.002827 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 17:03:55.017473 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.017446 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dpjln"] Jun 11 17:03:55.120936 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.120870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qd98\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-kube-api-access-4qd98\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.121111 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.120956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.221809 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.221718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qd98\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-kube-api-access-4qd98\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.221809 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.221770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.230399 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.230367 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.230542 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.230474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qd98\" (UniqueName: \"kubernetes.io/projected/4081d670-109c-47a3-bf6c-3fff01f0ba10-kube-api-access-4qd98\") pod \"cert-manager-cainjector-5d99449ffd-dpjln\" (UID: \"4081d670-109c-47a3-bf6c-3fff01f0ba10\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.317090 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.317035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" Jun 11 17:03:55.455059 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.455035 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dpjln"] Jun 11 17:03:55.457625 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:03:55.457585 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4081d670_109c_47a3_bf6c_3fff01f0ba10.slice/crio-f2505475491871801d99938f277436d9c9c1d11946a6c6c29f04f8af5b1019bb WatchSource:0}: Error finding container f2505475491871801d99938f277436d9c9c1d11946a6c6c29f04f8af5b1019bb: Status 404 returned error can't find the container with id f2505475491871801d99938f277436d9c9c1d11946a6c6c29f04f8af5b1019bb Jun 11 17:03:55.694082 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:55.694044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" event={"ID":"4081d670-109c-47a3-bf6c-3fff01f0ba10","Type":"ContainerStarted","Data":"f2505475491871801d99938f277436d9c9c1d11946a6c6c29f04f8af5b1019bb"} Jun 11 17:03:58.710396 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:58.710357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" event={"ID":"4081d670-109c-47a3-bf6c-3fff01f0ba10","Type":"ContainerStarted","Data":"1e59c665faab5a76be473decd3f7ad340e214aeb46363146cfe7f349ce88a241"} Jun 11 17:03:59.187631 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:59.187596 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:59.262257 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:03:59.262211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:00.284477 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:00.284449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:02.025717 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:02.025670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:02.135013 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:02.134978 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:07.829892 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:07.829859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:07.932677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:07.932641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:10.044205 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:10.044166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:17.941631 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:17.941590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:18.005234 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:18.005200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:21.181153 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:21.181115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:21.280459 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:21.280424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:21.845408 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:21.845363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.162730 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.162654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.269976 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.269943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.316086 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.316023 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dpjln" podStartSLOduration=25.285711763 podStartE2EDuration="28.315999314s" totalImagesPullingTime="3.030287551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:03:58.730342377 +0000 UTC m=+560.707298054" watchObservedRunningTime="2026-06-11 17:04:22.315999314 +0000 UTC m=+584.292954991" Jun 11 17:04:22.317314 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.317286 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4"] Jun 11 17:04:22.324871 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.324844 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.338336 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.338309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 17:04:22.338520 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.338337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 17:04:22.338520 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.338371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 17:04:22.338520 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.338473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 17:04:22.339078 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.339058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6sbj9\"" Jun 11 17:04:22.340477 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.340449 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4"] Jun 11 17:04:22.354173 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.354141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.354356 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.354192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.354356 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.354216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.354356 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.354301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqqt\" (UniqueName: \"kubernetes.io/projected/f91c25d1-f185-43f9-afe7-49f6bc715e31-kube-api-access-btqqt\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.354356 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.354353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.453008 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.452883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.455134 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.455228 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.455228 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqqt\" (UniqueName: \"kubernetes.io/projected/f91c25d1-f185-43f9-afe7-49f6bc715e31-kube-api-access-btqqt\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.455228 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.455353 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.455659 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.455626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-manifests\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.457507 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.457475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91c25d1-f185-43f9-afe7-49f6bc715e31-tmp\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.457621 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.457564 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.457731 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.457714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91c25d1-f185-43f9-afe7-49f6bc715e31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.467671 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.467645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqqt\" (UniqueName: \"kubernetes.io/projected/f91c25d1-f185-43f9-afe7-49f6bc715e31-kube-api-access-btqqt\") pod \"opendatahub-operator-controller-manager-7dbfc5486d-9jth4\" (UID: \"f91c25d1-f185-43f9-afe7-49f6bc715e31\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.551391 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.551344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.636252 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.636216 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:22.653101 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.653052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.758171 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.758138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:22.781032 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.781007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4"] Jun 11 17:04:22.783419 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:04:22.783385 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91c25d1_f185_43f9_afe7_49f6bc715e31.slice/crio-2906bf61eac548e5c282727f57798891f6f7f9a2becb29dd2bae3979f550b6d5 WatchSource:0}: Error finding container 2906bf61eac548e5c282727f57798891f6f7f9a2becb29dd2bae3979f550b6d5: Status 404 returned error can't find the container with id 2906bf61eac548e5c282727f57798891f6f7f9a2becb29dd2bae3979f550b6d5 Jun 11 17:04:22.809433 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.809396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" event={"ID":"f91c25d1-f185-43f9-afe7-49f6bc715e31","Type":"ContainerStarted","Data":"2906bf61eac548e5c282727f57798891f6f7f9a2becb29dd2bae3979f550b6d5"} Jun 11 17:04:22.856222 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:22.856182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:23.048404 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:23.048376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:26.833313 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:26.833277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" event={"ID":"f91c25d1-f185-43f9-afe7-49f6bc715e31","Type":"ContainerStarted","Data":"f3aeb1feba7bc7b85705452b9702f1db33b636b32eaa5588609d7212a59a9a75"} Jun 11 17:04:27.839350 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:27.839313 2579 generic.go:356] "Generic (PLEG): container finished" podID="f91c25d1-f185-43f9-afe7-49f6bc715e31" containerID="f3aeb1feba7bc7b85705452b9702f1db33b636b32eaa5588609d7212a59a9a75" exitCode=0 Jun 11 17:04:27.839742 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:27.839372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" event={"ID":"f91c25d1-f185-43f9-afe7-49f6bc715e31","Type":"ContainerDied","Data":"f3aeb1feba7bc7b85705452b9702f1db33b636b32eaa5588609d7212a59a9a75"} Jun 11 17:04:28.846033 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:28.845991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" event={"ID":"f91c25d1-f185-43f9-afe7-49f6bc715e31","Type":"ContainerStarted","Data":"7337336203feb43b1ffddc7869e592c542697fa44850baad3fe99ba2c3a9a337"} Jun 11 17:04:28.846468 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:28.846152 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:28.871524 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:28.871464 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" podStartSLOduration=2.162377005 podStartE2EDuration="6.871448011s" totalImagesPullingTime="3.678013865s" totalInitContainerRuntime="1.031057141s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:28.870200158 +0000 UTC m=+590.847155838" watchObservedRunningTime="2026-06-11 17:04:28.871448011 +0000 UTC m=+590.848403688" Jun 11 17:04:31.327229 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:31.327195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:32.328650 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:32.328606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:38.498833 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:38.498795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:04:38.499347 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:38.499329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:04:38.512746 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:38.512718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:04:38.513440 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:38.513414 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:04:39.853171 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:39.853142 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfc5486d-9jth4" Jun 11 17:04:41.621860 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:41.621824 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:41.771596 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:41.771566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:42.489793 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:42.489741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:42.636309 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:42.636274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:42.747851 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:42.747757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:42.861887 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:42.861850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:43.338199 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:43.338161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:43.463551 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:43.463502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:49.007719 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.007678 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz"] Jun 11 17:04:49.014096 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.014073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.017362 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017331 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 17:04:49.017505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7wmxc\"" Jun 11 17:04:49.017505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017399 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 17:04:49.017505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017445 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 17:04:49.017505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017458 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 17:04:49.017505 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.017484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 17:04:49.024744 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.024722 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz"] Jun 11 17:04:49.101412 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.101368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e92bbef-5708-428e-8ed8-50139d4ab40b-manager-config\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.101598 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.101440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.101598 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.101490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pd6l\" (UniqueName: \"kubernetes.io/projected/2e92bbef-5708-428e-8ed8-50139d4ab40b-kube-api-access-6pd6l\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.101598 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.101566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-metrics-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.202710 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.202651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.202710 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.202723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pd6l\" (UniqueName: \"kubernetes.io/projected/2e92bbef-5708-428e-8ed8-50139d4ab40b-kube-api-access-6pd6l\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.203037 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.202757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-metrics-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.203037 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.202785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e92bbef-5708-428e-8ed8-50139d4ab40b-manager-config\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.203466 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.203441 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e92bbef-5708-428e-8ed8-50139d4ab40b-manager-config\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.205249 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.205226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.205344 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.205259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e92bbef-5708-428e-8ed8-50139d4ab40b-metrics-cert\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.211949 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.211904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pd6l\" (UniqueName: \"kubernetes.io/projected/2e92bbef-5708-428e-8ed8-50139d4ab40b-kube-api-access-6pd6l\") pod \"lws-controller-manager-657f7c7877-x5ccz\" (UID: \"2e92bbef-5708-428e-8ed8-50139d4ab40b\") " pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.323981 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.323864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:49.464089 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.464062 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz"] Jun 11 17:04:49.467046 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:04:49.467017 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e92bbef_5708_428e_8ed8_50139d4ab40b.slice/crio-72b1e1c979512f3ffa13d35161c3dc80728cb3a2878d37fdeec33f53b1b1a0ad WatchSource:0}: Error finding container 72b1e1c979512f3ffa13d35161c3dc80728cb3a2878d37fdeec33f53b1b1a0ad: Status 404 returned error can't find the container with id 72b1e1c979512f3ffa13d35161c3dc80728cb3a2878d37fdeec33f53b1b1a0ad Jun 11 17:04:49.947498 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:49.947460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" event={"ID":"2e92bbef-5708-428e-8ed8-50139d4ab40b","Type":"ContainerStarted","Data":"72b1e1c979512f3ffa13d35161c3dc80728cb3a2878d37fdeec33f53b1b1a0ad"} Jun 11 17:04:52.965053 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:52.965011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" event={"ID":"2e92bbef-5708-428e-8ed8-50139d4ab40b","Type":"ContainerStarted","Data":"16605d8cb91dcd8ad3f3876c45f2ce5b248f7cea52103569675bfe853de9ed4b"} Jun 11 17:04:52.965584 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:52.965162 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:04:53.033989 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.033932 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" podStartSLOduration=2.613781172 podStartE2EDuration="5.033900275s" totalImagesPullingTime="2.420119103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:53.027257044 +0000 UTC m=+615.004212721" watchObservedRunningTime="2026-06-11 17:04:53.033900275 +0000 UTC m=+615.010855952" Jun 11 17:04:53.228635 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.228540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:53.300193 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.300151 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c"] Jun 11 17:04:53.303539 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.303518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.311462 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.311432 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 17:04:53.311711 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.311694 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 17:04:53.312136 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.312116 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lvlfn\"" Jun 11 17:04:53.312248 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.312229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 17:04:53.314759 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.314737 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 17:04:53.388542 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.388503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c"] Jun 11 17:04:53.400466 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.400425 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:53.445678 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.445426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.445678 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.445551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9z9w\" (UniqueName: \"kubernetes.io/projected/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-kube-api-access-c9z9w\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.445678 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.445610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tmp\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.546338 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.546301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9z9w\" (UniqueName: \"kubernetes.io/projected/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-kube-api-access-c9z9w\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.546540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.546368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tmp\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.546540 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.546390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.546655 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:04:53.546562 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 17:04:53.546655 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:04:53.546650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs podName:0cb86c8f-efc4-4f48-b321-a688fbd85b2f nodeName:}" failed. No retries permitted until 2026-06-11 17:04:54.046629952 +0000 UTC m=+616.023585609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs") pod "kube-auth-proxy-5968bff7d8-9m26c" (UID: "0cb86c8f-efc4-4f48-b321-a688fbd85b2f") : secret "kube-auth-proxy-tls" not found Jun 11 17:04:53.548633 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.548610 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tmp\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.565249 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.565217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9z9w\" (UniqueName: \"kubernetes.io/projected/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-kube-api-access-c9z9w\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:53.896716 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.896614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:53.986307 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:53.986269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:54.051821 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.051788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:54.054409 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.054386 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb86c8f-efc4-4f48-b321-a688fbd85b2f-tls-certs\") pod \"kube-auth-proxy-5968bff7d8-9m26c\" (UID: \"0cb86c8f-efc4-4f48-b321-a688fbd85b2f\") " pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:54.158713 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.158634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:54.214411 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.214375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" Jun 11 17:04:54.423678 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.423590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:54.437926 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.437888 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c"] Jun 11 17:04:54.440590 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:04:54.440558 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb86c8f_efc4_4f48_b321_a688fbd85b2f.slice/crio-c62e687e7fbbee9e3fad2fac0353e81f2c3d90cdb91936f5fb79e573335621b7 WatchSource:0}: Error finding container c62e687e7fbbee9e3fad2fac0353e81f2c3d90cdb91936f5fb79e573335621b7: Status 404 returned error can't find the container with id c62e687e7fbbee9e3fad2fac0353e81f2c3d90cdb91936f5fb79e573335621b7 Jun 11 17:04:54.976189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:54.976151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" event={"ID":"0cb86c8f-efc4-4f48-b321-a688fbd85b2f","Type":"ContainerStarted","Data":"c62e687e7fbbee9e3fad2fac0353e81f2c3d90cdb91936f5fb79e573335621b7"} Jun 11 17:04:55.258446 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:55.258379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:55.419050 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:55.419013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:58.000359 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:57.999254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" event={"ID":"0cb86c8f-efc4-4f48-b321-a688fbd85b2f","Type":"ContainerStarted","Data":"b35b512d492109f2a89b53c4b3874e23d45bc8b0adda3a3702815df265034f10"} Jun 11 17:04:58.037862 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:58.037797 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5968bff7d8-9m26c" podStartSLOduration=1.986672833 podStartE2EDuration="5.037778159s" totalImagesPullingTime="3.051105326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:04:58.034651093 +0000 UTC m=+620.011606769" watchObservedRunningTime="2026-06-11 17:04:58.037778159 +0000 UTC m=+620.014733840" Jun 11 17:04:58.746057 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:04:58.746024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:03.972687 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:03.972645 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-657f7c7877-x5ccz" Jun 11 17:05:06.279507 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:06.279468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:06.425415 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:06.425383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:07.825830 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:07.825792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:08.013527 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:08.013486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:08.210763 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:08.210667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:08.734290 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:08.734247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:08.915949 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:08.915887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:10.302152 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:10.302078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:21.736515 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:21.736478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:21.865086 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:21.865050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:22.419237 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:22.419203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:35.794718 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:35.794679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:36.055865 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:36.055721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:36.627482 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:36.627448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:36.871137 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:36.871098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:37.106705 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:37.106668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:37.454297 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:37.454197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:43.305815 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:43.305763 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:43.404589 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:43.404554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:43.523087 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:43.523054 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:44.729983 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:44.729950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:44.798201 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:44.798159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:45.634413 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:45.634383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:45.770771 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:45.770735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:46.330660 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:46.330623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:46.429264 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:46.429234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:56.308242 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:56.308208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:56.410306 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:56.410269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:56.480884 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:05:56.480850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:13.207878 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:13.207839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:17.329961 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:17.329933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:19.376121 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.376089 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh"] Jun 11 17:06:19.379467 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.379440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:19.387112 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.387093 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 17:06:19.387193 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.387093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ng47j\"" Jun 11 17:06:19.387493 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.387477 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 17:06:19.402752 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.402720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh"] Jun 11 17:06:19.535901 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.535864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69r5s\" (UniqueName: \"kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s\") pod \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" (UID: \"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:19.636792 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.636707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69r5s\" (UniqueName: \"kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s\") pod \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" (UID: \"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:19.649862 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.649835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69r5s\" (UniqueName: \"kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s\") pod \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" (UID: \"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:19.689715 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.689687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:19.858536 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.858501 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh"] Jun 11 17:06:19.861543 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:06:19.861518 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6e2cc9_dd86_41bc_9d05_6fc44d20c73c.slice/crio-3a725f131b36a0c39b1486ae636fdda25fa1be47b6b5a73853e596e6dfa8d29e WatchSource:0}: Error finding container 3a725f131b36a0c39b1486ae636fdda25fa1be47b6b5a73853e596e6dfa8d29e: Status 404 returned error can't find the container with id 3a725f131b36a0c39b1486ae636fdda25fa1be47b6b5a73853e596e6dfa8d29e Jun 11 17:06:19.863667 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:19.863650 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:06:20.005234 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:20.005197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:20.370128 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:20.370038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" event={"ID":"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c","Type":"ContainerStarted","Data":"3a725f131b36a0c39b1486ae636fdda25fa1be47b6b5a73853e596e6dfa8d29e"} Jun 11 17:06:23.179385 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:23.179349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:23.384677 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:23.384632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" event={"ID":"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c","Type":"ContainerStarted","Data":"a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c"} Jun 11 17:06:23.384879 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:23.384766 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:23.404823 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:23.404767 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" podStartSLOduration=1.543076364 podStartE2EDuration="4.404750074s" totalImagesPullingTime="2.86167371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:06:23.402829184 +0000 UTC m=+705.379784860" watchObservedRunningTime="2026-06-11 17:06:23.404750074 +0000 UTC m=+705.381705750" Jun 11 17:06:24.526992 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:24.526953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:24.621492 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:24.621452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:25.175334 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:25.175299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:26.357328 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:26.357294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:28.854412 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:28.854336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:28.955460 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:28.955426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:30.218235 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:30.218205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:30.306899 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:30.306870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:33.989430 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:33.989393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:34.109559 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:34.109524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:34.391207 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:34.391173 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:34.971571 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:34.971534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:35.378881 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:35.378850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:37.788125 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:37.788083 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:37.858331 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:37.858299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:45.104190 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.104156 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb"] Jun 11 17:06:45.107407 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.107389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.110387 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.110360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7z75q\"" Jun 11 17:06:45.130578 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.130548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb"] Jun 11 17:06:45.166028 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.165990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbrfw\" (UniqueName: \"kubernetes.io/projected/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-kube-api-access-jbrfw\") pod \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.166028 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.166030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.187741 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.187711 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb"] Jun 11 17:06:45.188032 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.188009 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jbrfw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" Jun 11 17:06:45.204170 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.204133 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb"] Jun 11 17:06:45.220977 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.220936 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh"] Jun 11 17:06:45.221165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.221134 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" containerName="manager" containerID="cri-o://a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c" gracePeriod=2 Jun 11 17:06:45.235376 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.235346 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh"] Jun 11 17:06:45.255219 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.255179 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-nqbjh\": pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.266646 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.266615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.266833 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.266759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbrfw\" (UniqueName: \"kubernetes.io/projected/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-kube-api-access-jbrfw\") pod \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.267000 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.266981 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.267758 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.267729 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4"] Jun 11 17:06:45.268345 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.268326 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" containerName="manager" Jun 11 17:06:45.268429 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.268347 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" containerName="manager" Jun 11 17:06:45.268469 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.268427 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" containerName="manager" Jun 11 17:06:45.269447 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.269425 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jbrfw for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-133-82.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object Jun 11 17:06:45.269531 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.269505 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-kube-api-access-jbrfw podName:6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2 nodeName:}" failed. No retries permitted until 2026-06-11 17:06:45.769484342 +0000 UTC m=+727.746439999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jbrfw" (UniqueName: "kubernetes.io/projected/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-kube-api-access-jbrfw") pod "kuadrant-operator-controller-manager-86878c769f-nlgkb" (UID: "6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-133-82.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object Jun 11 17:06:45.271808 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.271789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:45.274069 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.274043 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.283453 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.283427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4"] Jun 11 17:06:45.368068 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.367986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7fsq\" (UniqueName: \"kubernetes.io/projected/0cb34f24-f616-4d74-bb4a-4b68848722b7-kube-api-access-s7fsq\") pod \"limitador-operator-controller-manager-859d7b78bd-cv7g4\" (UID: \"0cb34f24-f616-4d74-bb4a-4b68848722b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:45.460201 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.460172 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.463769 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.463738 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.469269 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.469243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7fsq\" (UniqueName: \"kubernetes.io/projected/0cb34f24-f616-4d74-bb4a-4b68848722b7-kube-api-access-s7fsq\") pod \"limitador-operator-controller-manager-859d7b78bd-cv7g4\" (UID: \"0cb34f24-f616-4d74-bb4a-4b68848722b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:45.482612 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.482586 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7fsq\" (UniqueName: \"kubernetes.io/projected/0cb34f24-f616-4d74-bb4a-4b68848722b7-kube-api-access-s7fsq\") pod \"limitador-operator-controller-manager-859d7b78bd-cv7g4\" (UID: \"0cb34f24-f616-4d74-bb4a-4b68848722b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:45.486419 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.486396 2579 generic.go:356] "Generic (PLEG): container finished" podID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" containerID="a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c" exitCode=0 Jun 11 17:06:45.486525 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.486451 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.486525 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.486483 2579 scope.go:117] "RemoveContainer" containerID="a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c" Jun 11 17:06:45.486640 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.486594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.489110 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.489082 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.494694 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.494670 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.495085 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.495070 2579 scope.go:117] "RemoveContainer" containerID="a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c" Jun 11 17:06:45.495313 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.495296 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c\": container with ID starting with a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c not found: ID does not exist" containerID="a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c" Jun 11 17:06:45.495357 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.495321 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c"} err="failed to get container status \"a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c\": rpc error: code = NotFound desc = could not find container \"a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c\": container with ID starting with a00861fa072de95f2fa16f6672b876ee02eb0dd4db2dd3d615e742d8bea5289c not found: ID does not exist" Jun 11 17:06:45.496437 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.496418 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.498146 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.498131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.502612 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.502590 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.506852 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.506817 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.569858 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.569825 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69r5s\" (UniqueName: \"kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s\") pod \"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\" (UID: \"3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c\") " Jun 11 17:06:45.570033 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.569894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume\") pod \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\" (UID: \"6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2\") " Jun 11 17:06:45.570163 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.570146 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbrfw\" (UniqueName: \"kubernetes.io/projected/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-kube-api-access-jbrfw\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:06:45.570208 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.570158 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" (UID: "6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:06:45.572091 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.572071 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s" (OuterVolumeSpecName: "kube-api-access-69r5s") pod "3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" (UID: "3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c"). InnerVolumeSpecName "kube-api-access-69r5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:06:45.595875 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.595852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:45.671545 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.671511 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69r5s\" (UniqueName: \"kubernetes.io/projected/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c-kube-api-access-69r5s\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:06:45.671545 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.671547 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2-extensions-socket-volume\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:06:45.751773 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.751740 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4"] Jun 11 17:06:45.755300 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:06:45.755272 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb34f24_f616_4d74_bb4a_4b68848722b7.slice/crio-d71c4d79ebe2726b9c7506e78ecb236beece05ee884a742ad30f3d7d605a504e WatchSource:0}: Error finding container d71c4d79ebe2726b9c7506e78ecb236beece05ee884a742ad30f3d7d605a504e: Status 404 returned error can't find the container with id d71c4d79ebe2726b9c7506e78ecb236beece05ee884a742ad30f3d7d605a504e Jun 11 17:06:45.801395 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.801358 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:45.806452 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:45.806426 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:45.914527 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:45.914439 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:46.102648 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.102612 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:46.224053 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.223968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:46.340826 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.340793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:46.493023 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.492917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" event={"ID":"0cb34f24-f616-4d74-bb4a-4b68848722b7","Type":"ContainerStarted","Data":"659945d108ccd28d508abf45ccca526c821d8c96555ae6bbd22c5dd83ba59c7c"} Jun 11 17:06:46.493195 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.493077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:06:46.493195 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.493131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" event={"ID":"0cb34f24-f616-4d74-bb4a-4b68848722b7","Type":"ContainerStarted","Data":"d71c4d79ebe2726b9c7506e78ecb236beece05ee884a742ad30f3d7d605a504e"} Jun 11 17:06:46.494023 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.494005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:46.511901 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.508417 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" path="/var/lib/kubelet/pods/3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c/volumes" Jun 11 17:06:46.511901 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.508968 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" path="/var/lib/kubelet/pods/6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2/volumes" Jun 11 17:06:46.522165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:46.522124 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" podStartSLOduration=1.522111968 podStartE2EDuration="1.522111968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:06:46.5209644 +0000 UTC m=+728.497920078" watchObservedRunningTime="2026-06-11 17:06:46.522111968 +0000 UTC m=+728.499067644" Jun 11 17:06:46.522726 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:46.522695 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nlgkb\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="6aa78f60-2aa4-445d-9a7c-a31b7e5d56d2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nlgkb" Jun 11 17:06:46.524809 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:06:46.524788 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nqbjh\" is forbidden: User \"system:node:ip-10-0-133-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-82.ec2.internal' and this object" podUID="3b6e2cc9-dd86-41bc-9d05-6fc44d20c73c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nqbjh" Jun 11 17:06:48.450202 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:48.450166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:48.581575 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:48.581546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:51.573114 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:51.573083 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:51.878558 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:51.878464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:55.266316 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:55.266276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:55.472598 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:55.472567 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:57.194676 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:57.194638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:57.313492 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:57.313443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:57.501198 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:06:57.501170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cv7g4" Jun 11 17:07:04.150175 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:04.150142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:04.362987 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:04.362956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:04.528390 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:04.528352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:06.982802 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:06.982771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:07.170859 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:07.170826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:10.667992 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:10.667958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:10.801368 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:10.801326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:14.118692 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:14.118657 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:14.235878 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:14.235846 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:18.781283 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:18.781214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:19.133972 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:19.133865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:21.218088 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.218045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:21.416414 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.416376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:21.690917 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.690872 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:07:21.694983 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.694960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.699451 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.699431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p4xrl\"" Jun 11 17:07:21.700077 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.700054 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 17:07:21.715657 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.715625 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:07:21.765542 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.765509 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:07:21.787447 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.787415 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-config-file\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.787626 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.787543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8rkm\" (UniqueName: \"kubernetes.io/projected/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-kube-api-access-j8rkm\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.888932 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.888880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-config-file\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.889116 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.888989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8rkm\" (UniqueName: \"kubernetes.io/projected/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-kube-api-access-j8rkm\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.889511 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.889490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-config-file\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:21.907660 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:21.907626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8rkm\" (UniqueName: \"kubernetes.io/projected/3d7548c8-c097-4f05-b5a7-0c024d4ee95a-kube-api-access-j8rkm\") pod \"limitador-limitador-54d6d988d5-bzxp2\" (UID: \"3d7548c8-c097-4f05-b5a7-0c024d4ee95a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:22.005801 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.005769 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:22.177224 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.177075 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:07:22.180190 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:07:22.180160 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7548c8_c097_4f05_b5a7_0c024d4ee95a.slice/crio-e0dafa84d3d581c2d05459cf34bc74d44bfc33673697051591328ad7c0dd5624 WatchSource:0}: Error finding container e0dafa84d3d581c2d05459cf34bc74d44bfc33673697051591328ad7c0dd5624: Status 404 returned error can't find the container with id e0dafa84d3d581c2d05459cf34bc74d44bfc33673697051591328ad7c0dd5624 Jun 11 17:07:22.372366 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.372276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:22.440125 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.440087 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:07:22.444924 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.444893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:07:22.448593 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.448569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9sbrh\"" Jun 11 17:07:22.470738 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.470708 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:07:22.494599 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.494571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8w95\" (UniqueName: \"kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95\") pod \"authorino-75d556bd77-nx7nc\" (UID: \"41ee3e06-2717-4fb5-884c-9064fd764f31\") " pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:07:22.596071 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.595897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8w95\" (UniqueName: \"kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95\") pod \"authorino-75d556bd77-nx7nc\" (UID: \"41ee3e06-2717-4fb5-884c-9064fd764f31\") " pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:07:22.602496 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.602466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:22.608504 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.608474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8w95\" (UniqueName: \"kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95\") pod \"authorino-75d556bd77-nx7nc\" (UID: \"41ee3e06-2717-4fb5-884c-9064fd764f31\") " pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:07:22.671186 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.671097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" event={"ID":"3d7548c8-c097-4f05-b5a7-0c024d4ee95a","Type":"ContainerStarted","Data":"e0dafa84d3d581c2d05459cf34bc74d44bfc33673697051591328ad7c0dd5624"} Jun 11 17:07:22.754690 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.754651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:07:22.940960 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:22.940855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:07:22.946376 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:07:22.946326 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41ee3e06_2717_4fb5_884c_9064fd764f31.slice/crio-e79caecc78b55ef3fe99cc168969f07aefaf18806d9fe7851da60448e8b58481 WatchSource:0}: Error finding container e79caecc78b55ef3fe99cc168969f07aefaf18806d9fe7851da60448e8b58481: Status 404 returned error can't find the container with id e79caecc78b55ef3fe99cc168969f07aefaf18806d9fe7851da60448e8b58481 Jun 11 17:07:23.254892 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:23.254861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:23.356488 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:23.356459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:23.461349 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:23.461284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:23.561770 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:23.561667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:23.678721 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:23.678691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nx7nc" event={"ID":"41ee3e06-2717-4fb5-884c-9064fd764f31","Type":"ContainerStarted","Data":"e79caecc78b55ef3fe99cc168969f07aefaf18806d9fe7851da60448e8b58481"} Jun 11 17:07:25.692285 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:25.692247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" event={"ID":"3d7548c8-c097-4f05-b5a7-0c024d4ee95a","Type":"ContainerStarted","Data":"3b5f49809986d4f3723da9db10f25bc5e1d3db456deb076e08b5b4cd2bdfe5c3"} Jun 11 17:07:25.692760 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:25.692368 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:27.704866 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:27.704826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nx7nc" event={"ID":"41ee3e06-2717-4fb5-884c-9064fd764f31","Type":"ContainerStarted","Data":"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de"} Jun 11 17:07:27.752216 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:27.752153 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" podStartSLOduration=4.214112914 podStartE2EDuration="6.752131332s" totalImagesPullingTime="2.538018418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:07:25.773382358 +0000 UTC m=+767.750338036" watchObservedRunningTime="2026-06-11 17:07:27.752131332 +0000 UTC m=+769.729087007" Jun 11 17:07:27.752426 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:27.752273 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nx7nc" podStartSLOduration=1.102721652 podStartE2EDuration="5.752265827s" totalImagesPullingTime="4.649544175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:07:27.751474679 +0000 UTC m=+769.728430355" watchObservedRunningTime="2026-06-11 17:07:27.752265827 +0000 UTC m=+769.729221504" Jun 11 17:07:36.698692 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:36.698662 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzxp2" Jun 11 17:07:42.712583 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:42.712548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:53.228272 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:53.228230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:53.461054 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:53.460999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:53.709247 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:07:53.709202 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:20.690223 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:20.690183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:20.823996 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:20.823966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:54.283044 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.283002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:54.494217 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.494182 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:54.496546 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.496525 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:54.509314 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.509280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:54.626297 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.626201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kx5s\" (UniqueName: \"kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s\") pod \"authorino-5d4b67c446-7527p\" (UID: \"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485\") " pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:54.683808 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.683773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:54.727639 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.727587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kx5s\" (UniqueName: \"kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s\") pod \"authorino-5d4b67c446-7527p\" (UID: \"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485\") " pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:54.736734 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.736698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kx5s\" (UniqueName: \"kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s\") pod \"authorino-5d4b67c446-7527p\" (UID: \"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485\") " pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:54.741338 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.741307 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:54.741607 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.741590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:54.879443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.879414 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:54.881081 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:08:54.881051 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a6b6ed0_d358_4bcb_af8e_d67ab30cb485.slice/crio-744a90e9eeb01630f74d259c9dd97eafde90ee64629fa20e2e90c29c27555a62 WatchSource:0}: Error finding container 744a90e9eeb01630f74d259c9dd97eafde90ee64629fa20e2e90c29c27555a62: Status 404 returned error can't find the container with id 744a90e9eeb01630f74d259c9dd97eafde90ee64629fa20e2e90c29c27555a62 Jun 11 17:08:54.986429 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.986386 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:08:54.989270 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.989246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:54.991749 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.991726 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 17:08:54.999499 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:54.999473 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:08:55.031307 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.031266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.031484 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.031361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8fz\" (UniqueName: \"kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.110245 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.110209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7527p" event={"ID":"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485","Type":"ContainerStarted","Data":"744a90e9eeb01630f74d259c9dd97eafde90ee64629fa20e2e90c29c27555a62"} Jun 11 17:08:55.132666 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.132579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.132666 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.132661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8fz\" (UniqueName: \"kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.135022 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.135004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.141579 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.141557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8fz\" (UniqueName: \"kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz\") pod \"authorino-599f76bd96-nl8z2\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.299367 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.299341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:08:55.469799 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:55.469772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:08:55.471888 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:08:55.471856 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9024421_b736_4ceb_88d2_2931e920bda8.slice/crio-a067d28eda3355df0d3fc58a382db5a5570914524473f122e0e370b759205cfd WatchSource:0}: Error finding container a067d28eda3355df0d3fc58a382db5a5570914524473f122e0e370b759205cfd: Status 404 returned error can't find the container with id a067d28eda3355df0d3fc58a382db5a5570914524473f122e0e370b759205cfd Jun 11 17:08:56.117344 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.117240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7527p" event={"ID":"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485","Type":"ContainerStarted","Data":"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b"} Jun 11 17:08:56.117344 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.117264 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-7527p" podUID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" containerName="authorino" containerID="cri-o://f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b" gracePeriod=30 Jun 11 17:08:56.118690 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.118657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599f76bd96-nl8z2" event={"ID":"a9024421-b736-4ceb-88d2-2931e920bda8","Type":"ContainerStarted","Data":"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002"} Jun 11 17:08:56.118690 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.118692 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599f76bd96-nl8z2" event={"ID":"a9024421-b736-4ceb-88d2-2931e920bda8","Type":"ContainerStarted","Data":"a067d28eda3355df0d3fc58a382db5a5570914524473f122e0e370b759205cfd"} Jun 11 17:08:56.171855 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.171800 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-7527p" podStartSLOduration=1.7920632909999998 podStartE2EDuration="2.171785301s" totalImagesPullingTime="379.72201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:08:56.16869673 +0000 UTC m=+858.145652403" watchObservedRunningTime="2026-06-11 17:08:56.171785301 +0000 UTC m=+858.148741005" Jun 11 17:08:56.214504 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.214447 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-599f76bd96-nl8z2" podStartSLOduration=1.843322448 podStartE2EDuration="2.214428116s" totalImagesPullingTime="371.105668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:08:56.210515894 +0000 UTC m=+858.187471572" watchObservedRunningTime="2026-06-11 17:08:56.214428116 +0000 UTC m=+858.191383793" Jun 11 17:08:56.288146 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.288108 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:08:56.288351 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.288324 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nx7nc" podUID="41ee3e06-2717-4fb5-884c-9064fd764f31" containerName="authorino" containerID="cri-o://365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de" gracePeriod=30 Jun 11 17:08:56.400283 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.400257 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:56.442836 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.442803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kx5s\" (UniqueName: \"kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s\") pod \"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485\" (UID: \"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485\") " Jun 11 17:08:56.445141 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.445099 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s" (OuterVolumeSpecName: "kube-api-access-6kx5s") pod "3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" (UID: "3a6b6ed0-d358-4bcb-af8e-d67ab30cb485"). InnerVolumeSpecName "kube-api-access-6kx5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:08:56.535128 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.535098 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:08:56.543711 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.543678 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8w95\" (UniqueName: \"kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95\") pod \"41ee3e06-2717-4fb5-884c-9064fd764f31\" (UID: \"41ee3e06-2717-4fb5-884c-9064fd764f31\") " Jun 11 17:08:56.543896 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.543859 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kx5s\" (UniqueName: \"kubernetes.io/projected/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485-kube-api-access-6kx5s\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:08:56.545753 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.545724 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95" (OuterVolumeSpecName: "kube-api-access-v8w95") pod "41ee3e06-2717-4fb5-884c-9064fd764f31" (UID: "41ee3e06-2717-4fb5-884c-9064fd764f31"). InnerVolumeSpecName "kube-api-access-v8w95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:08:56.644667 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:56.644576 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8w95\" (UniqueName: \"kubernetes.io/projected/41ee3e06-2717-4fb5-884c-9064fd764f31-kube-api-access-v8w95\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:08:57.125039 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.125006 2579 generic.go:356] "Generic (PLEG): container finished" podID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" containerID="f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b" exitCode=0 Jun 11 17:08:57.125229 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.125049 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7527p" Jun 11 17:08:57.125229 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.125097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7527p" event={"ID":"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485","Type":"ContainerDied","Data":"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b"} Jun 11 17:08:57.125229 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.125137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7527p" event={"ID":"3a6b6ed0-d358-4bcb-af8e-d67ab30cb485","Type":"ContainerDied","Data":"744a90e9eeb01630f74d259c9dd97eafde90ee64629fa20e2e90c29c27555a62"} Jun 11 17:08:57.125229 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.125157 2579 scope.go:117] "RemoveContainer" containerID="f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b" Jun 11 17:08:57.126511 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.126494 2579 generic.go:356] "Generic (PLEG): container finished" podID="41ee3e06-2717-4fb5-884c-9064fd764f31" containerID="365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de" exitCode=0 Jun 11 17:08:57.126582 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.126544 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nx7nc" Jun 11 17:08:57.126582 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.126561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nx7nc" event={"ID":"41ee3e06-2717-4fb5-884c-9064fd764f31","Type":"ContainerDied","Data":"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de"} Jun 11 17:08:57.126671 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.126600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nx7nc" event={"ID":"41ee3e06-2717-4fb5-884c-9064fd764f31","Type":"ContainerDied","Data":"e79caecc78b55ef3fe99cc168969f07aefaf18806d9fe7851da60448e8b58481"} Jun 11 17:08:57.133888 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.133862 2579 scope.go:117] "RemoveContainer" containerID="f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b" Jun 11 17:08:57.134332 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:08:57.134187 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b\": container with ID starting with f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b not found: ID does not exist" containerID="f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b" Jun 11 17:08:57.134332 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.134220 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b"} err="failed to get container status \"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b\": rpc error: code = NotFound desc = could not find container \"f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b\": container with ID starting with f129626177e078ff244acb31439b45ceb5240e8de7698a95a46809fb8a94724b not found: ID does not exist" Jun 11 17:08:57.134332 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.134243 2579 scope.go:117] "RemoveContainer" containerID="365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de" Jun 11 17:08:57.142199 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.142180 2579 scope.go:117] "RemoveContainer" containerID="365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de" Jun 11 17:08:57.142477 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:08:57.142457 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de\": container with ID starting with 365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de not found: ID does not exist" containerID="365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de" Jun 11 17:08:57.142518 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.142486 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de"} err="failed to get container status \"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de\": rpc error: code = NotFound desc = could not find container \"365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de\": container with ID starting with 365a42f55ec86c2d6bb12458a804e7e402954b458247038d77c2df8614a7a2de not found: ID does not exist" Jun 11 17:08:57.148567 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.148535 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:57.154711 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.154685 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7527p"] Jun 11 17:08:57.166017 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.165992 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:08:57.171041 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:57.171017 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nx7nc"] Jun 11 17:08:58.507122 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:58.507084 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" path="/var/lib/kubelet/pods/3a6b6ed0-d358-4bcb-af8e-d67ab30cb485/volumes" Jun 11 17:08:58.507502 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:08:58.507427 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ee3e06-2717-4fb5-884c-9064fd764f31" path="/var/lib/kubelet/pods/41ee3e06-2717-4fb5-884c-9064fd764f31/volumes" Jun 11 17:09:00.003354 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.003326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:00.143650 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.143609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:00.239424 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.239391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:00.265208 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265127 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b9974cbf-85gn6"] Jun 11 17:09:00.265644 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265625 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ee3e06-2717-4fb5-884c-9064fd764f31" containerName="authorino" Jun 11 17:09:00.265717 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265646 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ee3e06-2717-4fb5-884c-9064fd764f31" containerName="authorino" Jun 11 17:09:00.265717 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265654 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" containerName="authorino" Jun 11 17:09:00.265717 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265660 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" containerName="authorino" Jun 11 17:09:00.265829 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265729 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6b6ed0-d358-4bcb-af8e-d67ab30cb485" containerName="authorino" Jun 11 17:09:00.265829 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.265742 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ee3e06-2717-4fb5-884c-9064fd764f31" containerName="authorino" Jun 11 17:09:00.268372 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.268349 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.272482 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.272459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8mj\" (UniqueName: \"kubernetes.io/projected/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-kube-api-access-zz8mj\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.272636 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.272613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-webhook-cert\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.273326 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.273304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 17:09:00.273426 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.273304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 17:09:00.273584 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.273567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n4c4f\"" Jun 11 17:09:00.286761 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.286730 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9974cbf-85gn6"] Jun 11 17:09:00.331398 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.331365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:00.373663 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.373629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-webhook-cert\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.373794 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.373680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8mj\" (UniqueName: \"kubernetes.io/projected/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-kube-api-access-zz8mj\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.376121 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.376092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-webhook-cert\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.382605 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.382583 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8mj\" (UniqueName: \"kubernetes.io/projected/8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57-kube-api-access-zz8mj\") pod \"maas-controller-b9974cbf-85gn6\" (UID: \"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57\") " pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.588974 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.588868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:00.719347 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:00.719312 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9974cbf-85gn6"] Jun 11 17:09:00.721155 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:09:00.721126 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf0bec6_77f8_4ce8_a8b6_8cb8e90a3a57.slice/crio-ccbcd9daa5c0f87cd27e89250555e3eb713e905e99da6666ad67a3a2cd0c656f WatchSource:0}: Error finding container ccbcd9daa5c0f87cd27e89250555e3eb713e905e99da6666ad67a3a2cd0c656f: Status 404 returned error can't find the container with id ccbcd9daa5c0f87cd27e89250555e3eb713e905e99da6666ad67a3a2cd0c656f Jun 11 17:09:01.151146 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:01.151104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9974cbf-85gn6" event={"ID":"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57","Type":"ContainerStarted","Data":"ccbcd9daa5c0f87cd27e89250555e3eb713e905e99da6666ad67a3a2cd0c656f"} Jun 11 17:09:03.163173 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:03.163114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9974cbf-85gn6" event={"ID":"8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57","Type":"ContainerStarted","Data":"630381ffbe77b91754488d8775e5cd2c6cbcdf6e23002a91e3929d7ff8d0a51a"} Jun 11 17:09:03.163598 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:03.163302 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:03.186253 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:03.186108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:03.206143 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:03.206091 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b9974cbf-85gn6" podStartSLOduration=1.010719704 podStartE2EDuration="3.206076963s" totalImagesPullingTime="2.195357259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:09:03.204822172 +0000 UTC m=+865.181777849" watchObservedRunningTime="2026-06-11 17:09:03.206076963 +0000 UTC m=+865.183032639" Jun 11 17:09:03.325961 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:03.325928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:14.175048 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:14.175005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b9974cbf-85gn6" Jun 11 17:09:33.447294 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:33.447254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:34.700068 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:34.700002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:34.756675 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:34.756633 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:09:36.146116 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:36.146061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:36.249312 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:36.249281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:38.537615 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:38.537582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:09:38.538318 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:38.538299 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:09:38.544321 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:38.544303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:09:38.544765 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:38.544748 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:09:45.342165 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:45.342128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:45.573925 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:45.573889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:45.858079 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:09:45.858037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:23.852344 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:23.852309 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-745965dfbb-r5fxv"] Jun 11 17:10:23.855072 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:23.855051 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:23.857689 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:23.857668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 17:10:23.866264 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:23.866240 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-745965dfbb-r5fxv"] Jun 11 17:10:24.029849 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.029812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xjq\" (UniqueName: \"kubernetes.io/projected/4fc43cbe-8d3f-4013-92ba-52692314c7c3-kube-api-access-h7xjq\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.029849 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.029855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fc43cbe-8d3f-4013-92ba-52692314c7c3-oidc-ca\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.030133 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.029965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fc43cbe-8d3f-4013-92ba-52692314c7c3-tls-cert\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.131123 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.131035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xjq\" (UniqueName: \"kubernetes.io/projected/4fc43cbe-8d3f-4013-92ba-52692314c7c3-kube-api-access-h7xjq\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.131123 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.131077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fc43cbe-8d3f-4013-92ba-52692314c7c3-oidc-ca\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.131123 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.131114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fc43cbe-8d3f-4013-92ba-52692314c7c3-tls-cert\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.131790 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.131766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fc43cbe-8d3f-4013-92ba-52692314c7c3-oidc-ca\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.133476 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.133458 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fc43cbe-8d3f-4013-92ba-52692314c7c3-tls-cert\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.139413 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.139389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xjq\" (UniqueName: \"kubernetes.io/projected/4fc43cbe-8d3f-4013-92ba-52692314c7c3-kube-api-access-h7xjq\") pod \"authorino-745965dfbb-r5fxv\" (UID: \"4fc43cbe-8d3f-4013-92ba-52692314c7c3\") " pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.163829 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.163801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745965dfbb-r5fxv" Jun 11 17:10:24.302278 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.302252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-745965dfbb-r5fxv"] Jun 11 17:10:24.304626 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:10:24.304597 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fc43cbe_8d3f_4013_92ba_52692314c7c3.slice/crio-e5559f0ba008965c6faa1cdb6298dc0c1403c60882eb4965f612cbd18d1fee2a WatchSource:0}: Error finding container e5559f0ba008965c6faa1cdb6298dc0c1403c60882eb4965f612cbd18d1fee2a: Status 404 returned error can't find the container with id e5559f0ba008965c6faa1cdb6298dc0c1403c60882eb4965f612cbd18d1fee2a Jun 11 17:10:24.551665 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:24.551632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745965dfbb-r5fxv" event={"ID":"4fc43cbe-8d3f-4013-92ba-52692314c7c3","Type":"ContainerStarted","Data":"e5559f0ba008965c6faa1cdb6298dc0c1403c60882eb4965f612cbd18d1fee2a"} Jun 11 17:10:25.558597 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:25.558560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-745965dfbb-r5fxv" event={"ID":"4fc43cbe-8d3f-4013-92ba-52692314c7c3","Type":"ContainerStarted","Data":"3f6ef90705027c8f80c3d52a67e3b161be6b23bebbde83e78fbd5a63763bc5ad"} Jun 11 17:10:25.578533 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:25.578476 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-745965dfbb-r5fxv" podStartSLOduration=2.16818046 podStartE2EDuration="2.578459352s" totalImagesPullingTime="410.278892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:10:25.577119693 +0000 UTC m=+947.554075371" watchObservedRunningTime="2026-06-11 17:10:25.578459352 +0000 UTC m=+947.555415029" Jun 11 17:10:25.619483 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:25.619449 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:10:25.619645 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:25.619624 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-599f76bd96-nl8z2" podUID="a9024421-b736-4ceb-88d2-2931e920bda8" containerName="authorino" containerID="cri-o://f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002" gracePeriod=30 Jun 11 17:10:25.872991 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:25.872963 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:10:26.053191 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.053140 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt8fz\" (UniqueName: \"kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz\") pod \"a9024421-b736-4ceb-88d2-2931e920bda8\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " Jun 11 17:10:26.053382 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.053329 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert\") pod \"a9024421-b736-4ceb-88d2-2931e920bda8\" (UID: \"a9024421-b736-4ceb-88d2-2931e920bda8\") " Jun 11 17:10:26.055355 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.055314 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz" (OuterVolumeSpecName: "kube-api-access-gt8fz") pod "a9024421-b736-4ceb-88d2-2931e920bda8" (UID: "a9024421-b736-4ceb-88d2-2931e920bda8"). InnerVolumeSpecName "kube-api-access-gt8fz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:10:26.063389 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.063362 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a9024421-b736-4ceb-88d2-2931e920bda8" (UID: "a9024421-b736-4ceb-88d2-2931e920bda8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:10:26.154187 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.154159 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9024421-b736-4ceb-88d2-2931e920bda8-tls-cert\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:10:26.154187 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.154186 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt8fz\" (UniqueName: \"kubernetes.io/projected/a9024421-b736-4ceb-88d2-2931e920bda8-kube-api-access-gt8fz\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:10:26.340412 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.340378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:26.460583 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.460458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:26.564321 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.564285 2579 generic.go:356] "Generic (PLEG): container finished" podID="a9024421-b736-4ceb-88d2-2931e920bda8" containerID="f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002" exitCode=0 Jun 11 17:10:26.564802 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.564334 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599f76bd96-nl8z2" Jun 11 17:10:26.564802 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.564376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599f76bd96-nl8z2" event={"ID":"a9024421-b736-4ceb-88d2-2931e920bda8","Type":"ContainerDied","Data":"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002"} Jun 11 17:10:26.564802 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.564431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599f76bd96-nl8z2" event={"ID":"a9024421-b736-4ceb-88d2-2931e920bda8","Type":"ContainerDied","Data":"a067d28eda3355df0d3fc58a382db5a5570914524473f122e0e370b759205cfd"} Jun 11 17:10:26.564802 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.564457 2579 scope.go:117] "RemoveContainer" containerID="f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002" Jun 11 17:10:26.573485 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.573466 2579 scope.go:117] "RemoveContainer" containerID="f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002" Jun 11 17:10:26.573744 ip-10-0-133-82 kubenswrapper[2579]: E0611 17:10:26.573724 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002\": container with ID starting with f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002 not found: ID does not exist" containerID="f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002" Jun 11 17:10:26.573805 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.573758 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002"} err="failed to get container status \"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002\": rpc error: code = NotFound desc = could not find container \"f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002\": container with ID starting with f196118b99203ead43aa196a0e746bae2843108ccbf8fb79a26f99e6d4469002 not found: ID does not exist" Jun 11 17:10:26.586465 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.586440 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:10:26.597454 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:26.597431 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-599f76bd96-nl8z2"] Jun 11 17:10:28.507804 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:28.507769 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9024421-b736-4ceb-88d2-2931e920bda8" path="/var/lib/kubelet/pods/a9024421-b736-4ceb-88d2-2931e920bda8/volumes" Jun 11 17:10:30.313569 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:30.313538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:43.865901 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:43.865865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:44.307024 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:44.306991 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:10:46.438239 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:46.438208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:47.007474 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:47.007435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:10:50.621085 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:50.621053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:52.825719 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.825679 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx"] Jun 11 17:10:52.826117 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.826093 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9024421-b736-4ceb-88d2-2931e920bda8" containerName="authorino" Jun 11 17:10:52.826117 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.826104 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9024421-b736-4ceb-88d2-2931e920bda8" containerName="authorino" Jun 11 17:10:52.826192 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.826162 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9024421-b736-4ceb-88d2-2931e920bda8" containerName="authorino" Jun 11 17:10:52.828937 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.828895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.833212 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.833188 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 17:10:52.833348 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.833219 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 17:10:52.833348 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.833258 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9k2vn\"" Jun 11 17:10:52.833348 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.833303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 17:10:52.847058 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.847032 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx"] Jun 11 17:10:52.858437 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.858406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:10:52.891234 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.891418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tflj\" (UniqueName: \"kubernetes.io/projected/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kube-api-access-9tflj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.891418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.891418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.891418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.891418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.891379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5bbd6a-018a-4bd5-918a-ff1902c65362-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992633 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tflj\" (UniqueName: \"kubernetes.io/projected/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kube-api-access-9tflj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992633 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992902 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992902 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992902 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5bbd6a-018a-4bd5-918a-ff1902c65362-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.992902 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.992839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.993261 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.993228 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.993394 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.993271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.993394 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.993337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.994979 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.994962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5bbd6a-018a-4bd5-918a-ff1902c65362-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:52.995434 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:52.995414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5bbd6a-018a-4bd5-918a-ff1902c65362-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:53.001321 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:53.001297 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tflj\" (UniqueName: \"kubernetes.io/projected/ef5bbd6a-018a-4bd5-918a-ff1902c65362-kube-api-access-9tflj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx\" (UID: \"ef5bbd6a-018a-4bd5-918a-ff1902c65362\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:53.139973 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:53.139880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:10:53.273424 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:53.273396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx"] Jun 11 17:10:53.275827 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:10:53.275799 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5bbd6a_018a_4bd5_918a_ff1902c65362.slice/crio-feafd62e6b9f25235491f9f5fc100fd5426d336b8a37828427020ed357c1731b WatchSource:0}: Error finding container feafd62e6b9f25235491f9f5fc100fd5426d336b8a37828427020ed357c1731b: Status 404 returned error can't find the container with id feafd62e6b9f25235491f9f5fc100fd5426d336b8a37828427020ed357c1731b Jun 11 17:10:53.615813 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:53.615773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:10:53.691710 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:53.691670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" event={"ID":"ef5bbd6a-018a-4bd5-918a-ff1902c65362","Type":"ContainerStarted","Data":"feafd62e6b9f25235491f9f5fc100fd5426d336b8a37828427020ed357c1731b"} Jun 11 17:10:56.711608 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:10:56.711529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" event={"ID":"ef5bbd6a-018a-4bd5-918a-ff1902c65362","Type":"ContainerStarted","Data":"0e37fffd36f0c98048fac2093da5bc5114b01b29e1c5f34ba15b052748a0ec2a"} Jun 11 17:11:09.815610 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:09.815534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:10.734408 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:10.734364 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:11:28.165634 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:28.165595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:29.223924 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:29.223871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:11:29.238254 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:29.238210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:33.150769 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:33.150724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:34.404147 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:11:34.404110 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzxp2"] Jun 11 17:12:13.810338 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:12:13.810302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:12:13.968256 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:12:13.968221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:12:39.328136 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:12:39.328037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:12:39.396566 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:12:39.396526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:13:37.501811 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:37.501777 2579 generic.go:356] "Generic (PLEG): container finished" podID="ef5bbd6a-018a-4bd5-918a-ff1902c65362" containerID="0e37fffd36f0c98048fac2093da5bc5114b01b29e1c5f34ba15b052748a0ec2a" exitCode=0 Jun 11 17:13:37.502265 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:37.501840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" event={"ID":"ef5bbd6a-018a-4bd5-918a-ff1902c65362","Type":"ContainerDied","Data":"0e37fffd36f0c98048fac2093da5bc5114b01b29e1c5f34ba15b052748a0ec2a"} Jun 11 17:13:37.502518 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:37.502500 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:13:39.521212 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:39.521166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" event={"ID":"ef5bbd6a-018a-4bd5-918a-ff1902c65362","Type":"ContainerStarted","Data":"e9e43e0757094a8d19aca20cac1b25d75f03bb0fc1ba398108c579ae43abca6f"} Jun 11 17:13:39.548210 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:39.548153 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" podStartSLOduration=3.257614902 podStartE2EDuration="2m47.548135692s" totalImagesPullingTime="4.137523135s" totalInitContainerRuntime="2m40.152997655s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:10:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:13:39.547170341 +0000 UTC m=+1141.524126018" watchObservedRunningTime="2026-06-11 17:13:39.548135692 +0000 UTC m=+1141.525091368" Jun 11 17:13:43.140960 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:43.140903 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:13:43.141483 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:43.141022 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:13:43.153329 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:43.153299 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:13:43.551498 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:13:43.551468 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx" Jun 11 17:14:38.569723 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:14:38.569684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:14:38.572285 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:14:38.572256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:14:38.576095 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:14:38.576074 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:14:38.578717 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:14:38.578697 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgjbk_df15ac63-af5f-438e-b960-dc42622b9864/ovn-acl-logging/0.log" Jun 11 17:15:00.186599 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.186563 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-wgbdv"] Jun 11 17:15:00.189021 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.189002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:00.198896 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.198868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fgnvg\"" Jun 11 17:15:00.214726 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.214692 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-wgbdv"] Jun 11 17:15:00.277666 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.277627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrs9\" (UniqueName: \"kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9\") pod \"maas-api-key-cleanup-29686635-wgbdv\" (UID: \"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9\") " pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:00.378952 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.378887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrs9\" (UniqueName: \"kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9\") pod \"maas-api-key-cleanup-29686635-wgbdv\" (UID: \"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9\") " pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:00.390411 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.390379 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrs9\" (UniqueName: \"kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9\") pod \"maas-api-key-cleanup-29686635-wgbdv\" (UID: \"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9\") " pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:00.501607 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.501576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:00.648975 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.648944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686635-wgbdv"] Jun 11 17:15:00.651531 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:15:00.651498 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2541ab_a2b9_41d1_b52c_bcf5f927b9a9.slice/crio-6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345 WatchSource:0}: Error finding container 6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345: Status 404 returned error can't find the container with id 6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345 Jun 11 17:15:00.904561 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:00.904472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" event={"ID":"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9","Type":"ContainerStarted","Data":"6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345"} Jun 11 17:15:03.921933 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:03.921877 2579 generic.go:356] "Generic (PLEG): container finished" podID="fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9" containerID="d685df72051276b7420cfbf6ea4a03acee3c25121fa8a6ef74d701ac35bfdc8f" exitCode=0 Jun 11 17:15:03.922301 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:03.921966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" event={"ID":"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9","Type":"ContainerDied","Data":"d685df72051276b7420cfbf6ea4a03acee3c25121fa8a6ef74d701ac35bfdc8f"} Jun 11 17:15:05.060778 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.060753 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:05.125014 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.124976 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlrs9\" (UniqueName: \"kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9\") pod \"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9\" (UID: \"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9\") " Jun 11 17:15:05.127180 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.127153 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9" (OuterVolumeSpecName: "kube-api-access-mlrs9") pod "fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9" (UID: "fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9"). InnerVolumeSpecName "kube-api-access-mlrs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:15:05.226679 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.226590 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlrs9\" (UniqueName: \"kubernetes.io/projected/fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9-kube-api-access-mlrs9\") on node \"ip-10-0-133-82.ec2.internal\" DevicePath \"\"" Jun 11 17:15:05.931848 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.931820 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" Jun 11 17:15:05.932023 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.931855 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686635-wgbdv" event={"ID":"fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9","Type":"ContainerDied","Data":"6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345"} Jun 11 17:15:05.932023 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:05.931902 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eb53dd66a4076462c8bb05525ccf746408d3c086a319addbb95fc3fff2ee345" Jun 11 17:15:57.205071 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:15:57.205036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:17:32.678975 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:32.678941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-745965dfbb-r5fxv_4fc43cbe-8d3f-4013-92ba-52692314c7c3/authorino/0.log" Jun 11 17:17:38.260512 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:38.260483 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686635-wgbdv_fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9/cleanup/0.log" Jun 11 17:17:38.392324 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:38.392297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b9974cbf-85gn6_8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57/manager/0.log" Jun 11 17:17:38.933233 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:38.933204 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-9jth4_f91c25d1-f185-43f9-afe7-49f6bc715e31/copy-manifests/0.log" Jun 11 17:17:38.945447 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:38.945424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-9jth4_f91c25d1-f185-43f9-afe7-49f6bc715e31/manager/0.log" Jun 11 17:17:40.676208 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:40.676184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-745965dfbb-r5fxv_4fc43cbe-8d3f-4013-92ba-52692314c7c3/authorino/0.log" Jun 11 17:17:41.419742 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:41.419704 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bzxp2_3d7548c8-c097-4f05-b5a7-0c024d4ee95a/limitador/0.log" Jun 11 17:17:41.544180 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:41.544149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cv7g4_0cb34f24-f616-4d74-bb4a-4b68848722b7/manager/0.log" Jun 11 17:17:42.168531 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:42.168493 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-9m26c_0cb86c8f-efc4-4f48-b321-a688fbd85b2f/kube-auth-proxy/0.log" Jun 11 17:17:43.492242 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:43.492213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx_ef5bbd6a-018a-4bd5-918a-ff1902c65362/main/0.log" Jun 11 17:17:43.500119 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:43.500098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-x2frx_ef5bbd6a-018a-4bd5-918a-ff1902c65362/storage-initializer/0.log" Jun 11 17:17:48.890364 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.890331 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dvddx/must-gather-4cjq5"] Jun 11 17:17:48.890786 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.890772 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9" containerName="cleanup" Jun 11 17:17:48.890829 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.890788 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9" containerName="cleanup" Jun 11 17:17:48.890872 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.890852 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9" containerName="cleanup" Jun 11 17:17:48.892870 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.892852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:48.896297 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.896277 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvddx\"/\"kube-root-ca.crt\"" Jun 11 17:17:48.897089 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.897070 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dvddx\"/\"default-dockercfg-q5hw5\"" Jun 11 17:17:48.897211 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.897073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dvddx\"/\"openshift-service-ca.crt\"" Jun 11 17:17:48.933216 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.933185 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/must-gather-4cjq5"] Jun 11 17:17:48.965081 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:48.965043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:17:49.027326 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.027286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmc42\" (UniqueName: \"kubernetes.io/projected/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-kube-api-access-bmc42\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.027515 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.027341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-must-gather-output\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.088310 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.088282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" limit=1024 Jun 11 17:17:49.128418 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.128379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmc42\" (UniqueName: \"kubernetes.io/projected/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-kube-api-access-bmc42\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.128581 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.128445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-must-gather-output\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.128823 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.128802 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-must-gather-output\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.149743 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.149676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmc42\" (UniqueName: \"kubernetes.io/projected/4b89bde6-4bb2-4bfe-b88d-15d2f2249793-kube-api-access-bmc42\") pod \"must-gather-4cjq5\" (UID: \"4b89bde6-4bb2-4bfe-b88d-15d2f2249793\") " pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.202069 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.202036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/must-gather-4cjq5" Jun 11 17:17:49.388727 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.386019 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/must-gather-4cjq5"] Jun 11 17:17:49.744879 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:49.744839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/must-gather-4cjq5" event={"ID":"4b89bde6-4bb2-4bfe-b88d-15d2f2249793","Type":"ContainerStarted","Data":"31f4ca433b6c69b66309e55ef5dc019413d81bb6347687544b92c957e0b9d735"} Jun 11 17:17:51.759653 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:51.759614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/must-gather-4cjq5" event={"ID":"4b89bde6-4bb2-4bfe-b88d-15d2f2249793","Type":"ContainerStarted","Data":"8f155545a1c48cacccafb2ab29cb529e5c09e84611aa9bf80207a6f954a8c6fb"} Jun 11 17:17:51.760061 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:51.759665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/must-gather-4cjq5" event={"ID":"4b89bde6-4bb2-4bfe-b88d-15d2f2249793","Type":"ContainerStarted","Data":"1944bd922041f381f09a9d962278de2b0c5697813c85e23f7493d7c0ffd1f598"} Jun 11 17:17:51.784443 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:51.784389 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dvddx/must-gather-4cjq5" podStartSLOduration=2.2910113020000002 podStartE2EDuration="3.784370652s" totalImagesPullingTime="1.49335935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:17:51.782590657 +0000 UTC m=+1393.759546344" watchObservedRunningTime="2026-06-11 17:17:51.784370652 +0000 UTC m=+1393.761326328" Jun 11 17:17:52.825014 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:52.824985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fj4ck_7c04944a-8044-4688-84cc-cf5a2fc6807e/global-pull-secret-syncer/0.log" Jun 11 17:17:52.894515 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:52.894485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5887v_94273d18-2c00-461d-bec8-c84507ac7cc0/konnectivity-agent/0.log" Jun 11 17:17:53.040485 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:53.040426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-82.ec2.internal_48789ea73209d8607b1fc3fcf49c9cc9/haproxy/0.log" Jun 11 17:17:58.658425 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:58.658385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-745965dfbb-r5fxv_4fc43cbe-8d3f-4013-92ba-52692314c7c3/authorino/0.log" Jun 11 17:17:58.913553 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:58.913456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bzxp2_3d7548c8-c097-4f05-b5a7-0c024d4ee95a/limitador/0.log" Jun 11 17:17:58.978081 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:17:58.977999 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cv7g4_0cb34f24-f616-4d74-bb4a-4b68848722b7/manager/0.log" Jun 11 17:18:00.807659 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:00.807628 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/alertmanager/0.log" Jun 11 17:18:00.864618 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:00.864527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/config-reloader/0.log" Jun 11 17:18:00.925278 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:00.925244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/kube-rbac-proxy-web/0.log" Jun 11 17:18:00.988189 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:00.988149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/kube-rbac-proxy/0.log" Jun 11 17:18:01.043221 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.043156 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/kube-rbac-proxy-metric/0.log" Jun 11 17:18:01.081749 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.081688 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/prom-label-proxy/0.log" Jun 11 17:18:01.128213 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.128121 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8ea93a-7cdd-4b8e-b586-7be34fe7f628/init-config-reloader/0.log" Jun 11 17:18:01.207772 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.207714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-zcpj5_7bfebf20-d7d3-4c3d-b248-9f89df2991bf/cluster-monitoring-operator/0.log" Jun 11 17:18:01.250742 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.250703 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g4cr5_6298ea9d-7f14-4006-af6e-d6651136b199/kube-state-metrics/0.log" Jun 11 17:18:01.309503 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.309473 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g4cr5_6298ea9d-7f14-4006-af6e-d6651136b199/kube-rbac-proxy-main/0.log" Jun 11 17:18:01.355674 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.355647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g4cr5_6298ea9d-7f14-4006-af6e-d6651136b199/kube-rbac-proxy-self/0.log" Jun 11 17:18:01.458347 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.458258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-9cz64_d7444039-6ea0-49bb-a209-a9d509f863f2/monitoring-plugin/0.log" Jun 11 17:18:01.887470 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.887442 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zf5_467875c9-bda8-4215-af83-5ffc7a2492ef/node-exporter/0.log" Jun 11 17:18:01.922337 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.922309 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zf5_467875c9-bda8-4215-af83-5ffc7a2492ef/kube-rbac-proxy/0.log" Jun 11 17:18:01.966407 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:01.966373 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zf5_467875c9-bda8-4215-af83-5ffc7a2492ef/init-textfile/0.log" Jun 11 17:18:02.022351 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.022319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-spsd6_a79b8154-a0f3-40f2-95b5-0b87790ffd14/kube-rbac-proxy-main/0.log" Jun 11 17:18:02.136270 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.136243 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-spsd6_a79b8154-a0f3-40f2-95b5-0b87790ffd14/kube-rbac-proxy-self/0.log" Jun 11 17:18:02.182051 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.181966 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-spsd6_a79b8154-a0f3-40f2-95b5-0b87790ffd14/openshift-state-metrics/0.log" Jun 11 17:18:02.246308 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.246273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/prometheus/0.log" Jun 11 17:18:02.299166 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.299132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/config-reloader/0.log" Jun 11 17:18:02.345350 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.345324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/thanos-sidecar/0.log" Jun 11 17:18:02.384486 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.384451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/kube-rbac-proxy-web/0.log" Jun 11 17:18:02.421096 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.421065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/kube-rbac-proxy/0.log" Jun 11 17:18:02.458479 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.458387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/kube-rbac-proxy-thanos/0.log" Jun 11 17:18:02.505904 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.505872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fa63ad5-417f-45c4-a6fa-3d5eb1d07bf1/init-config-reloader/0.log" Jun 11 17:18:02.567210 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.567170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-k2pdj_0ef291c0-04c2-4017-98c1-5128cf8f33cd/prometheus-operator/0.log" Jun 11 17:18:02.616684 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.616641 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq"] Jun 11 17:18:02.622806 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.622775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.645581 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.645540 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq"] Jun 11 17:18:02.653210 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.653091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-k2pdj_0ef291c0-04c2-4017-98c1-5128cf8f33cd/kube-rbac-proxy/0.log" Jun 11 17:18:02.678462 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.678413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-lib-modules\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.678670 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.678475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-sys\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.678670 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.678566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-podres\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.678670 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.678604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-proc\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.678816 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.678693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w269v\" (UniqueName: \"kubernetes.io/projected/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-kube-api-access-w269v\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.710893 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.710769 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-4cglx_f3bea835-2fcf-4c07-9837-1f432d69b5df/prometheus-operator-admission-webhook/0.log" Jun 11 17:18:02.747457 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.747426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-589ddbd944-tr5vm_62c307d3-4c76-4d49-965f-f3ed0165e19e/telemeter-client/0.log" Jun 11 17:18:02.779421 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-lib-modules\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.779645 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-sys\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.779645 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-podres\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.779645 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-proc\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.779645 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w269v\" (UniqueName: \"kubernetes.io/projected/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-kube-api-access-w269v\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.779946 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.779899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-sys\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.780061 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.780037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-proc\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.780198 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.780077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-lib-modules\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.780198 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.780118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-podres\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.787417 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.787389 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-589ddbd944-tr5vm_62c307d3-4c76-4d49-965f-f3ed0165e19e/reload/0.log" Jun 11 17:18:02.791016 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.790989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w269v\" (UniqueName: \"kubernetes.io/projected/06f59546-07fa-4cfc-83d0-91dd7d6dbb42-kube-api-access-w269v\") pod \"perf-node-gather-daemonset-x9mvq\" (UID: \"06f59546-07fa-4cfc-83d0-91dd7d6dbb42\") " pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:02.824318 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.824281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-589ddbd944-tr5vm_62c307d3-4c76-4d49-965f-f3ed0165e19e/kube-rbac-proxy/0.log" Jun 11 17:18:02.938822 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:02.938785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:03.120296 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:03.120262 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq"] Jun 11 17:18:03.122381 ip-10-0-133-82 kubenswrapper[2579]: W0611 17:18:03.122347 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06f59546_07fa_4cfc_83d0_91dd7d6dbb42.slice/crio-8df109eaa254cdd190f80bc0af3de418ee34791ab78be564a9123642bf18488a WatchSource:0}: Error finding container 8df109eaa254cdd190f80bc0af3de418ee34791ab78be564a9123642bf18488a: Status 404 returned error can't find the container with id 8df109eaa254cdd190f80bc0af3de418ee34791ab78be564a9123642bf18488a Jun 11 17:18:03.859678 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:03.859637 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" event={"ID":"06f59546-07fa-4cfc-83d0-91dd7d6dbb42","Type":"ContainerStarted","Data":"c9290da048e6654e021a59c49c3e5fac981a62c3bb5e3c3a0ffcf53faf44c8d1"} Jun 11 17:18:03.859861 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:03.859704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" event={"ID":"06f59546-07fa-4cfc-83d0-91dd7d6dbb42","Type":"ContainerStarted","Data":"8df109eaa254cdd190f80bc0af3de418ee34791ab78be564a9123642bf18488a"} Jun 11 17:18:03.859949 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:03.859865 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:03.888245 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:03.888182 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" podStartSLOduration=1.888158708 podStartE2EDuration="1.888158708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:18:03.886199262 +0000 UTC m=+1405.863154940" watchObservedRunningTime="2026-06-11 17:18:03.888158708 +0000 UTC m=+1405.865114386" Jun 11 17:18:05.121882 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:05.121853 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/1.log" Jun 11 17:18:05.127168 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:05.127146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ttqcl_e7d02125-cd09-487e-9f84-e5f8f4c7d669/console-operator/2.log" Jun 11 17:18:05.690850 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:05.690821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8rdp8_6dcbecf2-400c-4722-9d1e-4c6996089564/download-server/0.log" Jun 11 17:18:06.440831 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:06.440798 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wvftv_15469931-c674-496c-8f28-c67e0a48f491/volume-data-source-validator/0.log" Jun 11 17:18:07.800849 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:07.800821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jx4f_c898b89f-feaf-41d1-8310-cd479dbef86f/dns/0.log" Jun 11 17:18:07.830510 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:07.830483 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jx4f_c898b89f-feaf-41d1-8310-cd479dbef86f/kube-rbac-proxy/0.log" Jun 11 17:18:08.077114 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:08.077027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vbphz_40aed566-4224-4280-a5b1-b13adfda62de/dns-node-resolver/0.log" Jun 11 17:18:08.809518 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:08.809489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22qsf_0482ee12-b8a6-451a-9cbb-c70fc7435a62/node-ca/0.log" Jun 11 17:18:09.877475 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:09.877446 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dvddx/perf-node-gather-daemonset-x9mvq" Jun 11 17:18:10.177181 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:10.177081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-9m26c_0cb86c8f-efc4-4f48-b321-a688fbd85b2f/kube-auth-proxy/0.log" Jun 11 17:18:11.185282 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:11.185213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmlsv_662e86eb-499b-4a2f-bfb0-23bf36c01f7d/serve-healthcheck-canary/0.log" Jun 11 17:18:12.038049 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:12.038010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpbr4_a5eb1267-3a66-418e-b626-53f76c86ad45/kube-rbac-proxy/0.log" Jun 11 17:18:12.072948 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:12.072841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpbr4_a5eb1267-3a66-418e-b626-53f76c86ad45/exporter/0.log" Jun 11 17:18:12.111312 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:12.111262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lpbr4_a5eb1267-3a66-418e-b626-53f76c86ad45/extractor/0.log" Jun 11 17:18:15.234312 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:15.234234 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686635-wgbdv_fa2541ab-a2b9-41d1-b52c-bcf5f927b9a9/cleanup/0.log" Jun 11 17:18:15.285961 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:15.285934 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b9974cbf-85gn6_8cf0bec6-77f8-4ce8-a8b6-8cb8e90a3a57/manager/0.log" Jun 11 17:18:15.549604 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:15.549577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-9jth4_f91c25d1-f185-43f9-afe7-49f6bc715e31/manager/0.log" Jun 11 17:18:15.609533 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:15.609503 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfc5486d-9jth4_f91c25d1-f185-43f9-afe7-49f6bc715e31/copy-manifests/0.log" Jun 11 17:18:17.695692 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:17.695660 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-657f7c7877-x5ccz_2e92bbef-5708-428e-8ed8-50139d4ab40b/manager/0.log" Jun 11 17:18:18.014045 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:18.014012 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-9m26c_0cb86c8f-efc4-4f48-b321-a688fbd85b2f/kube-auth-proxy/0.log" Jun 11 17:18:19.596234 ip-10-0-133-82 kubenswrapper[2579]: I0611 17:18:19.596199 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5968bff7d8-9m26c_0cb86c8f-efc4-4f48-b321-a688fbd85b2f/kube-auth-proxy/0.log"