Jun 11 16:19:15.998109 ip-10-0-142-49 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:19:16.383139 ip-10-0-142-49 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:16.383139 ip-10-0-142-49 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:19:16.383139 ip-10-0-142-49 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:16.383724 ip-10-0-142-49 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:19:16.383724 ip-10-0-142-49 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:16.384739 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.384659 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390448 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390468 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390472 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390475 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390479 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.390473 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390482 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390485 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390488 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390490 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390493 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390496 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390499 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390501 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390504 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390507 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390509 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390513 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390517 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390520 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390523 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390526 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390529 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390532 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390535 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.390700 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390537 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390540 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390543 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390546 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390549 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390552 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390557 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390560 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390563 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390566 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390568 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390571 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390575 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390578 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390581 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390586 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390588 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390591 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390594 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.391177 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390596 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390599 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390603 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390606 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390609 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390612 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390614 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390617 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390620 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390623 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390625 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390628 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390630 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390633 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390635 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390638 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390642 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390645 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390648 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390651 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.391649 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390653 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390656 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390658 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390661 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390664 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390666 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390669 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390671 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390675 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390677 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390680 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390682 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390685 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390688 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390690 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390693 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390695 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390698 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390700 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390703 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.392165 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390706 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390709 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390711 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390714 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390717 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390719 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390722 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390725 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390728 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390731 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390733 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390736 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390738 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390741 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390744 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.390746 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391472 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391480 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391483 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391485 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.392650 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391489 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391492 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391495 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391498 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391500 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391503 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391506 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391509 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391512 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391514 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391517 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391520 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391522 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391526 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391529 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391531 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391534 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391537 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391540 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391542 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.393149 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391545 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391549 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391553 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391557 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391560 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391563 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391566 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391569 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391571 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391574 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391577 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391579 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391583 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391586 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391589 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391591 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391594 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391597 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391599 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.393662 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391602 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391604 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391607 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391609 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391612 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391615 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391617 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391620 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391623 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391625 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391628 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391631 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391633 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391636 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391638 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391641 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391643 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391646 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391649 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391651 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391654 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.394155 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391656 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391659 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391662 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391664 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391670 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391673 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391676 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391678 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391681 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391683 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391686 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391688 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391691 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391694 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391696 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391699 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391702 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391704 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391707 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.394678 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391711 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391715 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391718 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391721 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391725 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391728 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391731 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391733 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391737 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391740 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391743 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391746 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391749 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391752 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391755 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.391757 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392170 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392179 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392183 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.395169 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392185 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392188 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392191 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392194 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392197 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392199 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392202 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392205 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392208 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392210 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392213 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392215 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392218 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392221 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392223 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392226 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392228 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392231 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392233 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392236 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.395708 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392239 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392241 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392244 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392247 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392250 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392252 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392255 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392257 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392260 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392262 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392268 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392271 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392274 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392276 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392280 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392285 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392288 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392291 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392294 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.396229 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392297 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392300 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392303 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392305 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392308 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392311 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392313 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392316 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392319 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392322 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392324 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392326 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392329 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392332 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392335 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392338 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392340 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392343 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392345 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.396688 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392348 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392350 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392355 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392358 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392365 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392369 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392371 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392374 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392377 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392380 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392383 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392386 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392388 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392391 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392393 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392396 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392399 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392401 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392403 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392406 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.397184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392409 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392412 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392415 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392417 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392420 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392422 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392425 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392429 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392432 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392434 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392437 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392439 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392442 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392444 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392447 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392449 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392458 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.392461 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392527 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392534 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:19:16.397728 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392540 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392545 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392551 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392555 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392559 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392564 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392567 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392570 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392573 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392576 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392580 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392582 2557 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392586 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392589 2557 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392595 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392598 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392603 2557 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392606 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392609 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392613 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392616 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392620 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392623 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:19:16.398295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392626 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392629 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392632 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392635 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392638 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392644 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392647 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392652 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392655 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392658 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392661 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392664 2557 flags.go:64] FLAG: --enable-server="true" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392667 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392671 2557 flags.go:64] FLAG: --event-burst="100" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392674 2557 flags.go:64] FLAG: --event-qps="50" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392677 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392680 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392683 2557 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392687 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392690 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392693 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392695 2557 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392698 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392701 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392704 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:19:16.398868 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392707 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392710 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392713 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392716 2557 flags.go:64] FLAG: --feature-gates="" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392720 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392723 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392725 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392728 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392731 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392734 2557 flags.go:64] FLAG: --help="false" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392737 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392741 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392745 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392748 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392751 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392754 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392757 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392760 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392763 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392766 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392769 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392772 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392775 2557 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392777 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:19:16.399533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392780 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392783 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392786 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392789 2557 flags.go:64] FLAG: --lock-file="" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392791 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392794 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392814 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392822 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392826 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392829 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392832 2557 flags.go:64] FLAG: --logging-format="text" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392835 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392838 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392841 2557 flags.go:64] FLAG: --manifest-url="" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392844 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392848 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392851 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392855 2557 flags.go:64] FLAG: --max-pods="110" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392858 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392861 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392864 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392867 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392870 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392873 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392877 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:19:16.400149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392884 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392887 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392890 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392893 2557 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392896 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392902 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392905 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392908 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392911 2557 flags.go:64] FLAG: --port="10250" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392914 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392917 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa5151bcc503c8ec" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392920 2557 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392923 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392926 2557 flags.go:64] FLAG: --register-node="true" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392929 2557 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392933 2557 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392937 2557 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392940 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392942 2557 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392946 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392949 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392952 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392955 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392958 2557 flags.go:64] FLAG: --runonce="false" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392960 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:19:16.400792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392963 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392966 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392969 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392972 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392975 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392979 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392982 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392985 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392988 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392991 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392993 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392996 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.392999 2557 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393002 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393007 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393010 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393013 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393017 2557 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393020 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393023 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393026 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393028 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393031 2557 flags.go:64] FLAG: --v="2" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393035 2557 flags.go:64] FLAG: --version="false" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393040 2557 flags.go:64] FLAG: --vmodule="" Jun 11 16:19:16.401452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393043 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.393047 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393159 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393163 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393166 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393169 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393172 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393174 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393177 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393180 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393183 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393186 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393188 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393191 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393194 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393196 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393199 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393201 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393204 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393207 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.402134 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393209 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393211 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393214 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393216 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393219 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393221 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393224 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393226 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393229 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393231 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393234 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393236 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393243 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393246 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393248 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393251 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393253 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393256 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393258 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.402633 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393261 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393263 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393268 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393271 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393274 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393277 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393279 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393282 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393284 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393287 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393289 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393293 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393297 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393299 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393302 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393305 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393307 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393310 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393312 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393315 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.403109 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393318 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393320 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393323 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393325 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393328 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393332 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393336 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393340 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393343 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393345 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393349 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393351 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393363 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393367 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393372 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393376 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393379 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393382 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393384 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.403616 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393388 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393392 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393395 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393398 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393400 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393403 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393406 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393409 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393411 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393414 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393416 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393419 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393422 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393424 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393427 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393430 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393432 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393435 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393438 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393441 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.404099 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393445 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393447 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.393450 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.394231 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.400609 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.400624 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.401317 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.401329 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401394 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401400 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401403 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401406 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401409 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401412 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401414 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.404589 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401417 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401420 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401423 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401425 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401428 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401431 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401433 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401436 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401439 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401442 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401444 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401447 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401449 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401452 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401454 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401457 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401460 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401463 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401466 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.404977 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401469 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401472 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401474 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401478 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401481 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401484 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401487 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401490 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401493 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401495 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401498 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401500 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401503 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401505 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401508 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401511 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401513 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401516 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401519 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.405439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401521 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401525 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401529 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401532 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401535 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401538 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401540 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401543 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401545 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401548 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401551 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401553 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401556 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401558 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401561 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401564 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401567 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401571 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401573 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401576 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.405956 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401579 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401581 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401584 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401586 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401589 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401591 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401594 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401597 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401599 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401602 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401605 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401609 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401613 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401616 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401619 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401623 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401627 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401630 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401633 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.406476 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401635 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401638 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401641 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401644 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401646 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401649 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401651 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401654 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401656 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401660 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401663 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401666 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401669 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401671 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401673 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.406949 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.401679 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401793 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401814 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401818 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401821 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401824 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401827 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401829 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401832 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401834 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401838 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401840 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401843 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401846 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401849 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401851 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401855 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401858 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401860 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:16.407328 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401863 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401866 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401868 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401871 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401874 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401876 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401879 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401882 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401885 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401887 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401891 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401894 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401896 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401899 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401901 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401903 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401907 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401911 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401914 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:16.407786 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401917 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401920 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401923 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401926 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401928 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401931 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401933 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401936 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401938 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401941 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401943 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401946 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401948 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401951 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401953 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401956 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401958 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401961 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401963 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401966 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:16.408261 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401969 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401972 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401975 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401977 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401981 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401984 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401986 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401989 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401991 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401995 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.401999 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402001 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402004 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402007 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402010 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402012 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402015 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402017 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402020 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402023 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:16.408739 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402025 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402028 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402030 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402033 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402035 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402038 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402040 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402043 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402045 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402048 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402050 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402053 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402055 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402058 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402061 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402064 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402066 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402069 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402072 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402074 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:16.409242 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402076 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:16.402079 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.402084 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.402206 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.404072 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.405383 2557 server.go:1019] "Starting client certificate rotation" Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.405483 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.406340 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:16.409741 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.408188 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:16.412233 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.412211 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:16.421433 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.421417 2557 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:19:16.425185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.425171 2557 log.go:25] "Validated CRI v1 image API" Jun 11 16:19:16.426003 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.425985 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:19:16.429044 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.429022 2557 fs.go:135] Filesystem UUIDs: map[21602ecf-548c-4f16-91e6-3340df586505:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a9ab1ff6-c2ed-4fc6-94c7-cfadbef79a89:/dev/nvme0n1p4] Jun 11 16:19:16.429105 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.429045 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:19:16.434896 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.434772 2557 manager.go:216] Machine: {Timestamp:2026-06-11 16:19:16.43332601 +0000 UTC m=+0.320931150 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100820 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1b873e6603e94bf0ebd85d6fec91 SystemUUID:ec2b1b87-3e66-03e9-4bf0-ebd85d6fec91 BootID:3d18a12a-b0f4-4f92-8fb0-1b0cc4ea1e11 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:5a:d1:52:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:5a:d1:52:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:71:3e:4c:ac:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:19:16.434896 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.434890 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:19:16.435006 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.434963 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:19:16.437709 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.437686 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:19:16.437853 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.437711 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:19:16.438389 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.438379 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:19:16.438422 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.438392 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:19:16.438422 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.438399 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:16.438999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.438989 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:16.439742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.439732 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:19:16.442393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442378 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:16.442540 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442527 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:16.442671 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442662 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:19:16.442706 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442691 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:19:16.442706 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442700 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:19:16.442757 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442713 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:19:16.442757 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442723 2557 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:19:16.442757 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.442732 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:19:16.443110 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.443099 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:16.443153 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.443122 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:16.445195 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.445179 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:19:16.446664 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.446651 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:19:16.446714 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.446683 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:19:16.447740 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447729 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:19:16.447777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447745 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:19:16.447777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447751 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:19:16.447777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447757 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:19:16.447777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447766 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:19:16.447777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447772 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447784 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447791 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447810 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447816 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447824 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:19:16.447933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.447830 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:19:16.448517 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.448507 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:19:16.448549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.448519 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:19:16.451695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.451681 2557 server.go:1268] "Started kubelet" Jun 11 16:19:16.451776 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.451756 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:19:16.451979 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.451920 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:19:16.452077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.452009 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:19:16.452534 ip-10-0-142-49 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:19:16.456230 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.456207 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:19:16.458189 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.458167 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:19:16.458345 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.458317 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:19:16.458564 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.458477 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:19:16.458778 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.458729 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:19:16.461971 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.461952 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:19:16.462369 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.462348 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:19:16.462369 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.462357 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:16.462508 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.462427 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:16.462925 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.462909 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:19:16.462925 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.462909 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:19:16.463091 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.462935 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:19:16.463091 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463046 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:19:16.463091 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463055 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:19:16.463252 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463225 2557 factory.go:55] Registering systemd factory Jun 11 16:19:16.463252 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463241 2557 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:19:16.463450 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463434 2557 factory.go:153] Registering CRI-O factory Jun 11 16:19:16.463498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463454 2557 factory.go:223] Registration of the crio container factory successfully Jun 11 16:19:16.463547 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463510 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:19:16.463547 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463536 2557 factory.go:103] Registering Raw factory Jun 11 16:19:16.463644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463555 2557 manager.go:1196] Started watching for new ooms in manager Jun 11 16:19:16.463897 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.463884 2557 manager.go:349] Starting recovery of all containers Jun 11 16:19:16.464245 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.463324 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319e16d6a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.451653289 +0000 UTC m=+0.339258426,LastTimestamp:2026-06-11 16:19:16.451653289 +0000 UTC m=+0.339258426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.472380 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.472215 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:19:16.472380 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.472239 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:19:16.473955 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.473939 2557 manager.go:354] Recovery completed Jun 11 16:19:16.478453 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.478439 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.482013 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.481989 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.482087 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482024 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.482087 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482034 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.482590 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482580 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.482630 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482583 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:19:16.482658 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482631 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:19:16.482658 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.482647 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:16.484044 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484032 2557 policy_none.go:49] "None policy: Start" Jun 11 16:19:16.484077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484048 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:19:16.484077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484058 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:19:16.484361 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.484274 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe61103 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482011395 +0000 UTC m=+0.369616534,LastTimestamp:2026-06-11 16:19:16.482011395 +0000 UTC m=+0.369616534,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.484810 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484781 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.484864 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484824 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.484864 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.484835 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.485206 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.485193 2557 policy_none.go:47] "Start" Jun 11 16:19:16.500283 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.500180 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe65609 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482029065 +0000 UTC m=+0.369634202,LastTimestamp:2026-06-11 16:19:16.482029065 +0000 UTC m=+0.369634202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.510498 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.510435 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe679a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482038177 +0000 UTC m=+0.369643313,LastTimestamp:2026-06-11 16:19:16.482038177 +0000 UTC m=+0.369643313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.520757 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.520735 2557 manager.go:337] "Starting Device Plugin manager" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.520776 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.520789 2557 server.go:87] "Starting device plugin registration server" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.521060 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.521071 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.521161 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.521246 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.521257 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.522028 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.522076 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.522393 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-49.ec2.internal.18b813319fe61103\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe61103 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482011395 +0000 UTC m=+0.369616534,LastTimestamp:2026-06-11 16:19:16.484811218 +0000 UTC m=+0.372416355,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.530648 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.531867 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.531908 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.531932 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:19:16.532205 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.531969 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:19:16.537351 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.537325 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 11 16:19:16.537512 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.537452 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-49.ec2.internal.18b813319fe65609\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe65609 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482029065 +0000 UTC m=+0.369634202,LastTimestamp:2026-06-11 16:19:16.484829283 +0000 UTC m=+0.372434420,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.543188 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.543128 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-49.ec2.internal.18b813319fe679a1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe679a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482038177 +0000 UTC m=+0.369643313,LastTimestamp:2026-06-11 16:19:16.484838719 +0000 UTC m=+0.372443855,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.548081 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.548019 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b81331a2589406 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.52307047 +0000 UTC m=+0.410675597,LastTimestamp:2026-06-11 16:19:16.52307047 +0000 UTC m=+0.410675597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.621540 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.621507 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.622629 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.622609 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.622742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.622642 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.622742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.622656 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.622742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.622681 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.625008 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.624918 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-49.ec2.internal.18b813319fe61103\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe61103 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482011395 +0000 UTC m=+0.369616534,LastTimestamp:2026-06-11 16:19:16.622626963 +0000 UTC m=+0.510232099,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.632395 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.632375 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal"] Jun 11 16:19:16.632478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.632440 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.633375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.633306 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.633375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.633342 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.633375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.633368 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.634591 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.634578 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.634715 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.634696 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.634751 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.634727 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.635335 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635321 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.635390 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635346 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.635390 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635356 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.635451 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635327 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.635451 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635421 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.635451 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.635431 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.636823 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.636790 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.636882 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.636846 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.637085 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.637069 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpsxv" Jun 11 16:19:16.637603 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.637588 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.637693 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.637619 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.637693 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.637633 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.639409 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.639381 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.639519 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.639426 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-49.ec2.internal.18b813319fe65609\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-49.ec2.internal.18b813319fe65609 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-49.ec2.internal,UID:ip-10-0-142-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-49.ec2.internal,},FirstTimestamp:2026-06-11 16:19:16.482029065 +0000 UTC m=+0.369634202,LastTimestamp:2026-06-11 16:19:16.622649398 +0000 UTC m=+0.510254540,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-49.ec2.internal,}" Jun 11 16:19:16.644029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.644013 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpsxv" Jun 11 16:19:16.656429 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.656408 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-49.ec2.internal\" not found" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.660023 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.659995 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-49.ec2.internal\" not found" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.663714 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.663693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.663809 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.663731 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.663809 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.663752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/793eafcf8812d9f307dfb0f2621e1603-config\") pod \"kube-apiserver-proxy-ip-10-0-142-49.ec2.internal\" (UID: \"793eafcf8812d9f307dfb0f2621e1603\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.683931 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.683905 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-49.ec2.internal\" not found" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.763886 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763849 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.763886 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.764103 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/793eafcf8812d9f307dfb0f2621e1603-config\") pod \"kube-apiserver-proxy-ip-10-0-142-49.ec2.internal\" (UID: \"793eafcf8812d9f307dfb0f2621e1603\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.764103 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/793eafcf8812d9f307dfb0f2621e1603-config\") pod \"kube-apiserver-proxy-ip-10-0-142-49.ec2.internal\" (UID: \"793eafcf8812d9f307dfb0f2621e1603\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.764103 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763963 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.764103 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.763973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/029ddcd912c1ebb1f4de8d65cacc25ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal\" (UID: \"029ddcd912c1ebb1f4de8d65cacc25ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.840146 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.840115 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:16.841219 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.841201 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:16.841316 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.841237 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:16.841316 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.841250 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:16.841316 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.841277 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.849716 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.849698 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.849774 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.849725 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-49.ec2.internal\": node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:16.891059 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.890980 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:16.960391 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.960360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.964110 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:16.963981 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:16.991849 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:16.991819 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.092335 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.092301 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.192841 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.192755 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.293383 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.293344 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.331159 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.331131 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:17.393733 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.393701 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.404903 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.404874 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:19:17.405092 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.405066 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:17.463441 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:17.463395 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793eafcf8812d9f307dfb0f2621e1603.slice/crio-9d59fdf4bdbe58d83f6a8e7b68ccdd9f69ed1b1e3c2a6087d5863d398f04b16c WatchSource:0}: Error finding container 9d59fdf4bdbe58d83f6a8e7b68ccdd9f69ed1b1e3c2a6087d5863d398f04b16c: Status 404 returned error can't find the container with id 9d59fdf4bdbe58d83f6a8e7b68ccdd9f69ed1b1e3c2a6087d5863d398f04b16c Jun 11 16:19:17.463703 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:17.463685 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029ddcd912c1ebb1f4de8d65cacc25ac.slice/crio-502d2b83c41fba2a7a193aa24bf7dab56df888ece354cd3942e5d0afc9e95fbe WatchSource:0}: Error finding container 502d2b83c41fba2a7a193aa24bf7dab56df888ece354cd3942e5d0afc9e95fbe: Status 404 returned error can't find the container with id 502d2b83c41fba2a7a193aa24bf7dab56df888ece354cd3942e5d0afc9e95fbe Jun 11 16:19:17.467353 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.467338 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:19:17.494482 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.494458 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.534792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.534751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" event={"ID":"793eafcf8812d9f307dfb0f2621e1603","Type":"ContainerStarted","Data":"9d59fdf4bdbe58d83f6a8e7b68ccdd9f69ed1b1e3c2a6087d5863d398f04b16c"} Jun 11 16:19:17.535770 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.535753 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" event={"ID":"029ddcd912c1ebb1f4de8d65cacc25ac","Type":"ContainerStarted","Data":"502d2b83c41fba2a7a193aa24bf7dab56df888ece354cd3942e5d0afc9e95fbe"} Jun 11 16:19:17.595296 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.595262 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.603139 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.603114 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:17.647036 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.646989 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:14:16 +0000 UTC" deadline="2028-03-21 07:26:50.938275814 +0000 UTC" Jun 11 16:19:17.647143 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.647030 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15567h7m33.29124892s" Jun 11 16:19:17.657093 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.657070 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:17.675637 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.675616 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:17.676636 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.676615 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:17.676727 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.676654 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:17.676727 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.676670 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:17.695774 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:17.695753 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-49.ec2.internal\" not found" Jun 11 16:19:17.737615 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.737559 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:17.762542 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.762514 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" Jun 11 16:19:17.777435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.777416 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:17.778572 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.778558 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" Jun 11 16:19:17.790158 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:17.790144 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:18.443400 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.443322 2557 apiserver.go:52] "Watching apiserver" Jun 11 16:19:18.450426 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.450398 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:19:18.450736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.450715 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nvz7x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh","openshift-dns/node-resolver-mbjn4","openshift-multus/multus-additional-cni-plugins-cwhdk","openshift-multus/network-metrics-daemon-hc4dt","openshift-network-operator/iptables-alerter-dxgxg","openshift-ovn-kubernetes/ovnkube-node-94znb","kube-system/global-pull-secret-syncer-crrdf","kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xqxvm","openshift-image-registry/node-ca-99fkl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal","openshift-multus/multus-9ktx7","openshift-network-diagnostics/network-check-target-sfcw7"] Jun 11 16:19:18.451980 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.451967 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.452047 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.452029 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:18.453057 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.453041 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.454119 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.454103 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.455440 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.455424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.456074 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.456053 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2mn7f\"" Jun 11 16:19:18.456216 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.456089 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.456278 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.456236 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.456766 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.456752 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.456983 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.456968 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:19:18.458148 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458126 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.458248 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458173 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.458248 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458199 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:19:18.458248 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458240 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.458400 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458264 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4xt8f\"" Jun 11 16:19:18.458400 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.458352 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.459952 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.459586 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.460087 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460054 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.460087 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460067 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:19:18.460202 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460108 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q6jbp\"" Jun 11 16:19:18.460202 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460062 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:19:18.460294 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460250 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:19:18.460546 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460530 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.460606 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460553 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.460606 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.460572 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:19:18.461042 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.461023 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.461151 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.461128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:18.461688 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.461672 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-td8kl\"" Jun 11 16:19:18.461764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.461698 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:19:18.462558 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.462541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.462707 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.462558 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.462707 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.462543 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:19:18.463089 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.463068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.463469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.463449 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:19:18.463552 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.463481 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-src2g\"" Jun 11 16:19:18.464125 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.464105 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:19:18.464357 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.464339 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcwkj\"" Jun 11 16:19:18.464667 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.463458 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:18.464836 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.464658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:19:18.465550 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.465524 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.467476 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.465914 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8sxtf\"" Jun 11 16:19:18.467476 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.465923 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.467476 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.467236 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.468203 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.468181 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:19:18.468292 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.468276 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-79m6b\"" Jun 11 16:19:18.468439 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.468420 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:19:18.468543 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.468518 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:19:18.469870 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.469851 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.471258 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.471236 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:18.471335 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.471297 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:18.471865 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.471849 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:19:18.472270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-modprobe-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.472369 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws5k2\" (UniqueName: \"kubernetes.io/projected/5374ba43-7006-45fe-a566-301bd90a57e0-kube-api-access-ws5k2\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.472369 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-os-release\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.472469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472342 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bh7lh\"" Jun 11 16:19:18.472469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472422 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd07688a-2e63-4bc2-b93a-a576607255bc-konnectivity-ca\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.472469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s75rj\" (UniqueName: \"kubernetes.io/projected/e6993041-e8d6-416f-b702-fdd8adc34b9e-kube-api-access-s75rj\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-script-lib\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472498 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-kubelet-config\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2kn\" (UniqueName: \"kubernetes.io/projected/82a4dcc6-86f8-4a17-b32b-6166ff650641-kube-api-access-hr2kn\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-log-socket\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-dbus\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.472619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-systemd\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472645 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-host\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472685 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-socket-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-iptables-alerter-script\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz72\" (UniqueName: \"kubernetes.io/projected/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-kube-api-access-cbz72\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6993041-e8d6-416f-b702-fdd8adc34b9e-tmp-dir\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sj4s\" (UniqueName: \"kubernetes.io/projected/361bae7b-4994-4bcc-a66e-27b967508e7f-kube-api-access-8sj4s\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.472893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-host-slash\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472965 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-systemd-units\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.472989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-var-lib-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-ovn\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-node-log\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovn-node-metrics-cert\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99kj\" (UniqueName: \"kubernetes.io/projected/3aa98384-4c4e-42cf-903b-39f1f04bd265-kube-api-access-v99kj\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-lib-modules\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.473164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-etc-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-env-overrides\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-sys\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-system-cni-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473257 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-var-lib-kubelet\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473311 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-registration-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-device-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473444 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nwrf\" (UniqueName: \"kubernetes.io/projected/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kube-api-access-5nwrf\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-netd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-config\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5374ba43-7006-45fe-a566-301bd90a57e0-serviceca\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.473624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-conf\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-run\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473703 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-sys-fs\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473734 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysconfig\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-tuned\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6993041-e8d6-416f-b702-fdd8adc34b9e-hosts-file\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473839 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5374ba43-7006-45fe-a566-301bd90a57e0-host\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473903 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-kubelet\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-netns\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473968 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.473986 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-bin\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6bc\" (UniqueName: \"kubernetes.io/projected/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-kube-api-access-hs6bc\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd07688a-2e63-4bc2-b93a-a576607255bc-agent-certs\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.474191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474027 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-slash\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.474682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-kubernetes\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-tmp\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.474682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cnibin\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.474682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.474134 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-systemd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.478879 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.478861 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:18.500882 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.500863 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-29qnw" Jun 11 16:19:18.512118 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.512101 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-29qnw" Jun 11 16:19:18.564150 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.564124 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:19:18.574283 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-var-lib-kubelet\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574296 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-socket-dir-parent\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-hostroot\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574386 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-var-lib-kubelet\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.574423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-registration-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574450 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-registration-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-device-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nwrf\" (UniqueName: \"kubernetes.io/projected/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kube-api-access-5nwrf\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-netd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-device-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.574506 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574576 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-netd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-config\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5374ba43-7006-45fe-a566-301bd90a57e0-serviceca\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.574690 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.574661 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:19.074620625 +0000 UTC m=+2.962225763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-conf\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-run\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-netns\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-multus-certs\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574937 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-etc-kubernetes\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574965 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-sys-fs\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.574967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-conf\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysconfig\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-tuned\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575133 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysconfig\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575158 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5374ba43-7006-45fe-a566-301bd90a57e0-serviceca\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.575209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575197 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-run\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-sys-fs\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6993041-e8d6-416f-b702-fdd8adc34b9e-hosts-file\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575360 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575441 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-config\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.575485 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575515 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5374ba43-7006-45fe-a566-301bd90a57e0-host\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575566 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5374ba43-7006-45fe-a566-301bd90a57e0-host\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-kubelet\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575637 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-netns\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.575724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575611 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6993041-e8d6-416f-b702-fdd8adc34b9e-hosts-file\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-bin\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.575785 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:19.075747727 +0000 UTC m=+2.963352851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575778 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-kubelet\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6bc\" (UniqueName: \"kubernetes.io/projected/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-kube-api-access-hs6bc\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575854 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-cni-bin\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd07688a-2e63-4bc2-b93a-a576607255bc-agent-certs\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575877 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-netns\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-slash\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575925 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.575964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-kubernetes\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576006 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-slash\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-tmp\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9t8\" (UniqueName: \"kubernetes.io/projected/d63814e7-bf6f-456e-bd50-36c7656687f3-kube-api-access-jb9t8\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.576477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576064 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cnibin\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576106 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cnibin\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576128 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-systemd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-kubernetes\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-modprobe-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws5k2\" (UniqueName: \"kubernetes.io/projected/5374ba43-7006-45fe-a566-301bd90a57e0-kube-api-access-ws5k2\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-systemd\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-os-release\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd07688a-2e63-4bc2-b93a-a576607255bc-konnectivity-ca\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576444 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-modprobe-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s75rj\" (UniqueName: \"kubernetes.io/projected/e6993041-e8d6-416f-b702-fdd8adc34b9e-kube-api-access-s75rj\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-k8s-cni-cncf-io\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-script-lib\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-os-release\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-kubelet-config\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.577229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-conf-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2kn\" (UniqueName: \"kubernetes.io/projected/82a4dcc6-86f8-4a17-b32b-6166ff650641-kube-api-access-hr2kn\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-log-socket\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576877 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd07688a-2e63-4bc2-b93a-a576607255bc-konnectivity-ca\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576862 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-kubelet-config\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.576924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-dbus\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577041 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/caf2e313-c9de-42f7-901b-cc83af612fa8-dbus\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-systemd\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovnkube-script-lib\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-host\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-systemd\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-multus\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577165 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-host\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577151 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-log-socket\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-daemon-config\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577214 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-socket-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-iptables-alerter-script\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.578037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz72\" (UniqueName: \"kubernetes.io/projected/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-kube-api-access-cbz72\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-socket-dir\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577391 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6993041-e8d6-416f-b702-fdd8adc34b9e-tmp-dir\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sj4s\" (UniqueName: \"kubernetes.io/projected/361bae7b-4994-4bcc-a66e-27b967508e7f-kube-api-access-8sj4s\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-os-release\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-cni-binary-copy\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-host-slash\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6993041-e8d6-416f-b702-fdd8adc34b9e-tmp-dir\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577876 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-iptables-alerter-script\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/875ae7c8-53d3-4297-b5a1-dd4587c45f02-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.577908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-host-slash\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-systemd-units\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-var-lib-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-ovn\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578528 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-systemd-units\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.578756 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-node-log\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovn-node-metrics-cert\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578619 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-node-log\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578645 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-var-lib-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99kj\" (UniqueName: \"kubernetes.io/projected/3aa98384-4c4e-42cf-903b-39f1f04bd265-kube-api-access-v99kj\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-run-ovn\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-lib-modules\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-system-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-cnibin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-bin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-etc-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-env-overrides\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578905 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-sysctl-d\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-sys\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578936 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-etc-tuned\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.579554 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.578989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-kubelet\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579034 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-lib-modules\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579037 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3aa98384-4c4e-42cf-903b-39f1f04bd265-etc-openvswitch\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-system-cni-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.580375 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.579091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-system-cni-dir\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.580869 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.580819 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361bae7b-4994-4bcc-a66e-27b967508e7f-sys\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.581130 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.581109 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3aa98384-4c4e-42cf-903b-39f1f04bd265-env-overrides\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.581291 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.581274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361bae7b-4994-4bcc-a66e-27b967508e7f-tmp\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.581452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.581432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.581512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.581478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd07688a-2e63-4bc2-b93a-a576607255bc-agent-certs\") pod \"konnectivity-agent-nvz7x\" (UID: \"cd07688a-2e63-4bc2-b93a-a576607255bc\") " pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.584401 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.581830 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3aa98384-4c4e-42cf-903b-39f1f04bd265-ovn-node-metrics-cert\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.584971 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.584947 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nwrf\" (UniqueName: \"kubernetes.io/projected/875ae7c8-53d3-4297-b5a1-dd4587c45f02-kube-api-access-5nwrf\") pod \"aws-ebs-csi-driver-node-n9szh\" (UID: \"875ae7c8-53d3-4297-b5a1-dd4587c45f02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.589471 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.589410 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6bc\" (UniqueName: \"kubernetes.io/projected/abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7-kube-api-access-hs6bc\") pod \"iptables-alerter-dxgxg\" (UID: \"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7\") " pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.589471 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.589429 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws5k2\" (UniqueName: \"kubernetes.io/projected/5374ba43-7006-45fe-a566-301bd90a57e0-kube-api-access-ws5k2\") pod \"node-ca-99fkl\" (UID: \"5374ba43-7006-45fe-a566-301bd90a57e0\") " pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.590350 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.590302 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz72\" (UniqueName: \"kubernetes.io/projected/3a2f847a-eae6-4648-b8bd-cdb3e0274c3c-kube-api-access-cbz72\") pod \"multus-additional-cni-plugins-cwhdk\" (UID: \"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c\") " pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.591584 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.591565 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2kn\" (UniqueName: \"kubernetes.io/projected/82a4dcc6-86f8-4a17-b32b-6166ff650641-kube-api-access-hr2kn\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:18.591919 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.591894 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s75rj\" (UniqueName: \"kubernetes.io/projected/e6993041-e8d6-416f-b702-fdd8adc34b9e-kube-api-access-s75rj\") pod \"node-resolver-mbjn4\" (UID: \"e6993041-e8d6-416f-b702-fdd8adc34b9e\") " pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.594849 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.594829 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99kj\" (UniqueName: \"kubernetes.io/projected/3aa98384-4c4e-42cf-903b-39f1f04bd265-kube-api-access-v99kj\") pod \"ovnkube-node-94znb\" (UID: \"3aa98384-4c4e-42cf-903b-39f1f04bd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.595282 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.595253 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sj4s\" (UniqueName: \"kubernetes.io/projected/361bae7b-4994-4bcc-a66e-27b967508e7f-kube-api-access-8sj4s\") pod \"tuned-xqxvm\" (UID: \"361bae7b-4994-4bcc-a66e-27b967508e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.682581 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9t8\" (UniqueName: \"kubernetes.io/projected/d63814e7-bf6f-456e-bd50-36c7656687f3-kube-api-access-jb9t8\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682581 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-k8s-cni-cncf-io\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-conf-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682651 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-conf-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-multus\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682691 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-daemon-config\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682670 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-k8s-cni-cncf-io\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682707 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-multus\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-os-release\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.682793 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-cni-binary-copy\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682768 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-os-release\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-system-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-cnibin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682892 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-bin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-system-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682965 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-kubelet\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-cnibin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682978 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-cni-bin\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.682995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-socket-dir-parent\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-var-lib-kubelet\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-hostroot\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683066 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-netns\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-multus-certs\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-socket-dir-parent\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-etc-kubernetes\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683122 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-hostroot\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683155 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683170 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-netns\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683222 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-etc-kubernetes\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-host-run-multus-certs\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-cni-binary-copy\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683288 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-cni-dir\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.683752 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.683267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d63814e7-bf6f-456e-bd50-36c7656687f3-multus-daemon-config\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.699140 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.699065 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:18.699140 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.699099 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:18.699140 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.699112 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:18.699379 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:18.699201 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:19.199177076 +0000 UTC m=+3.086782218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:18.701436 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.701414 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9t8\" (UniqueName: \"kubernetes.io/projected/d63814e7-bf6f-456e-bd50-36c7656687f3-kube-api-access-jb9t8\") pod \"multus-9ktx7\" (UID: \"d63814e7-bf6f-456e-bd50-36c7656687f3\") " pod="openshift-multus/multus-9ktx7" Jun 11 16:19:18.762877 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.762839 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-99fkl" Jun 11 16:19:18.773986 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.773959 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxgxg" Jun 11 16:19:18.780667 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.780644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" Jun 11 16:19:18.787360 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.787336 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:18.792910 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.792890 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mbjn4" Jun 11 16:19:18.799757 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.799736 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:18.806517 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.806496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" Jun 11 16:19:18.811535 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.811504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" Jun 11 16:19:18.816187 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:18.816169 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9ktx7" Jun 11 16:19:19.087218 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.087137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:19.087218 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.087179 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:19.087404 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.087326 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:19.087404 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.087382 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:20.087368733 +0000 UTC m=+3.974973857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:19.087503 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.087328 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:19.087503 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.087471 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:20.087452725 +0000 UTC m=+3.975057864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:19.288369 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.288319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:19.288529 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.288491 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:19.288529 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.288511 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:19.288529 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.288520 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:19.288626 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.288580 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:20.28856425 +0000 UTC m=+4.176169378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:19.514992 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.514893 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:18 +0000 UTC" deadline="2028-03-18 19:44:56.71008317 +0000 UTC" Jun 11 16:19:19.514992 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.514935 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15507h25m37.1951534s" Jun 11 16:19:19.532176 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:19.532145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:19.532340 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:19.532260 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:19.674007 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.673978 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2f847a_eae6_4648_b8bd_cdb3e0274c3c.slice/crio-32ce5b52fa3dca979e92f0f3743da4e1ef85f4be92511b9dadbca8981ec4efd7 WatchSource:0}: Error finding container 32ce5b52fa3dca979e92f0f3743da4e1ef85f4be92511b9dadbca8981ec4efd7: Status 404 returned error can't find the container with id 32ce5b52fa3dca979e92f0f3743da4e1ef85f4be92511b9dadbca8981ec4efd7 Jun 11 16:19:19.675453 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.675415 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63814e7_bf6f_456e_bd50_36c7656687f3.slice/crio-e5c95dd4bef1e9e0b0cee31f038c096ba47d546857553602891c509636b8849f WatchSource:0}: Error finding container e5c95dd4bef1e9e0b0cee31f038c096ba47d546857553602891c509636b8849f: Status 404 returned error can't find the container with id e5c95dd4bef1e9e0b0cee31f038c096ba47d546857553602891c509636b8849f Jun 11 16:19:19.678150 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.678070 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb5b5b1_0f16_46d5_a0a8_bbaf300ddaa7.slice/crio-680db4b6fcd294b6558c521e0e4d98edeed9c3269d181d5c9ea3d898547fda67 WatchSource:0}: Error finding container 680db4b6fcd294b6558c521e0e4d98edeed9c3269d181d5c9ea3d898547fda67: Status 404 returned error can't find the container with id 680db4b6fcd294b6558c521e0e4d98edeed9c3269d181d5c9ea3d898547fda67 Jun 11 16:19:19.681011 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.680985 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361bae7b_4994_4bcc_a66e_27b967508e7f.slice/crio-5ffe1b3bcd0a06c27fbc7722abdb28952c55b1a47ed35b772882693bc75b2da6 WatchSource:0}: Error finding container 5ffe1b3bcd0a06c27fbc7722abdb28952c55b1a47ed35b772882693bc75b2da6: Status 404 returned error can't find the container with id 5ffe1b3bcd0a06c27fbc7722abdb28952c55b1a47ed35b772882693bc75b2da6 Jun 11 16:19:19.681701 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.681668 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5374ba43_7006_45fe_a566_301bd90a57e0.slice/crio-a9ffbc1a369c346a82c3192acc1ae21ae74ad3a536b7a3cfa45e0cd002277c56 WatchSource:0}: Error finding container a9ffbc1a369c346a82c3192acc1ae21ae74ad3a536b7a3cfa45e0cd002277c56: Status 404 returned error can't find the container with id a9ffbc1a369c346a82c3192acc1ae21ae74ad3a536b7a3cfa45e0cd002277c56 Jun 11 16:19:19.683846 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.683547 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa98384_4c4e_42cf_903b_39f1f04bd265.slice/crio-5308b47e0bf4ef7f5f3a7641aa4c7d1f2eccf1c888bcc6d6797756c77ef7e23f WatchSource:0}: Error finding container 5308b47e0bf4ef7f5f3a7641aa4c7d1f2eccf1c888bcc6d6797756c77ef7e23f: Status 404 returned error can't find the container with id 5308b47e0bf4ef7f5f3a7641aa4c7d1f2eccf1c888bcc6d6797756c77ef7e23f Jun 11 16:19:19.685768 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:19.685327 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd07688a_2e63_4bc2_b93a_a576607255bc.slice/crio-9d828ecedae2b3a70238cf45ebec4dc6358b92b34148b8dd7f441456095b5119 WatchSource:0}: Error finding container 9d828ecedae2b3a70238cf45ebec4dc6358b92b34148b8dd7f441456095b5119: Status 404 returned error can't find the container with id 9d828ecedae2b3a70238cf45ebec4dc6358b92b34148b8dd7f441456095b5119 Jun 11 16:19:20.094434 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.094173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:20.094612 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.094455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:20.094672 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.094619 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:20.094729 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.094683 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:22.094664692 +0000 UTC m=+5.982269818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:20.094790 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.094748 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:20.094790 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.094787 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:22.094774294 +0000 UTC m=+5.982379422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:20.290644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.290565 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:20.296287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.296240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:20.296437 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.296425 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:20.296489 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.296448 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:20.296489 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.296461 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:20.296674 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.296515 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:22.296498109 +0000 UTC m=+6.184103237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:20.515695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.515632 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:18 +0000 UTC" deadline="2027-12-24 13:31:45.509586933 +0000 UTC" Jun 11 16:19:20.515695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.515694 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13461h12m24.993897589s" Jun 11 16:19:20.534548 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.534519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:20.534710 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.534648 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:20.535054 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.535032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:20.535145 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:20.535128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:20.553960 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.553879 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxgxg" event={"ID":"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7","Type":"ContainerStarted","Data":"680db4b6fcd294b6558c521e0e4d98edeed9c3269d181d5c9ea3d898547fda67"} Jun 11 16:19:20.571869 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.571828 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerStarted","Data":"32ce5b52fa3dca979e92f0f3743da4e1ef85f4be92511b9dadbca8981ec4efd7"} Jun 11 16:19:20.585662 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.585626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-99fkl" event={"ID":"5374ba43-7006-45fe-a566-301bd90a57e0","Type":"ContainerStarted","Data":"a9ffbc1a369c346a82c3192acc1ae21ae74ad3a536b7a3cfa45e0cd002277c56"} Jun 11 16:19:20.595895 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.595831 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvz7x" event={"ID":"cd07688a-2e63-4bc2-b93a-a576607255bc","Type":"ContainerStarted","Data":"9d828ecedae2b3a70238cf45ebec4dc6358b92b34148b8dd7f441456095b5119"} Jun 11 16:19:20.603384 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.603352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9ktx7" event={"ID":"d63814e7-bf6f-456e-bd50-36c7656687f3","Type":"ContainerStarted","Data":"e5c95dd4bef1e9e0b0cee31f038c096ba47d546857553602891c509636b8849f"} Jun 11 16:19:20.611911 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.611188 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" event={"ID":"793eafcf8812d9f307dfb0f2621e1603","Type":"ContainerStarted","Data":"8a562b36f3884068f1d585800868193ecadca27c760c4aea2dfaa2bbcffbe59f"} Jun 11 16:19:20.628278 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.628248 2557 generic.go:356] "Generic (PLEG): container finished" podID="029ddcd912c1ebb1f4de8d65cacc25ac" containerID="0b17a536025b8ffa9d07a9e30adc3bfb2a5ff62b09d17fb9875f870860aea364" exitCode=0 Jun 11 16:19:20.628425 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.628334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" event={"ID":"029ddcd912c1ebb1f4de8d65cacc25ac","Type":"ContainerDied","Data":"0b17a536025b8ffa9d07a9e30adc3bfb2a5ff62b09d17fb9875f870860aea364"} Jun 11 16:19:20.644310 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.642168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mbjn4" event={"ID":"e6993041-e8d6-416f-b702-fdd8adc34b9e","Type":"ContainerStarted","Data":"d7aad3a0c42149a675a3fff293f9ebddb78b35b7686d30dc40f9fa2d88049b41"} Jun 11 16:19:20.647023 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.646990 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" event={"ID":"875ae7c8-53d3-4297-b5a1-dd4587c45f02","Type":"ContainerStarted","Data":"2fc3a93b35fd5134ab0eb8c4a1566a3218b9b25b57f04f126937606841d64901"} Jun 11 16:19:20.654492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.654462 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"5308b47e0bf4ef7f5f3a7641aa4c7d1f2eccf1c888bcc6d6797756c77ef7e23f"} Jun 11 16:19:20.659762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.659708 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-49.ec2.internal" podStartSLOduration=3.659687733 podStartE2EDuration="3.659687733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:20.632611491 +0000 UTC m=+4.520216639" watchObservedRunningTime="2026-06-11 16:19:20.659687733 +0000 UTC m=+4.547292876" Jun 11 16:19:20.661891 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:20.661861 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" event={"ID":"361bae7b-4994-4bcc-a66e-27b967508e7f","Type":"ContainerStarted","Data":"5ffe1b3bcd0a06c27fbc7722abdb28952c55b1a47ed35b772882693bc75b2da6"} Jun 11 16:19:21.532905 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:21.532875 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:21.533345 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:21.533013 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:21.689165 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:21.689100 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" event={"ID":"029ddcd912c1ebb1f4de8d65cacc25ac","Type":"ContainerStarted","Data":"dba4e6831ff3ce6d371acc4945e730b415a0d226b3382a249fac2d547df3e953"} Jun 11 16:19:22.113856 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:22.113818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:22.114038 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:22.113878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:22.114038 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.113998 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:22.114142 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.114062 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:26.114042896 +0000 UTC m=+10.001648034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:22.114483 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.114461 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:22.114583 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.114516 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:26.114502935 +0000 UTC m=+10.002108063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:22.314777 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:22.314694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:22.314951 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.314907 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:22.314951 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.314935 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:22.314951 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.314947 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:22.315118 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.315006 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:26.314989225 +0000 UTC m=+10.202594365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:22.535112 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:22.533912 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:22.535112 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.534054 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:22.535112 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:22.534497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:22.535112 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:22.534581 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:23.533015 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:23.532949 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:23.533202 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:23.533094 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:24.533825 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:24.532818 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:24.533825 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:24.532866 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:24.533825 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:24.532957 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:24.533825 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:24.533360 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:25.533069 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:25.533035 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:25.533267 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:25.533183 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:26.148929 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:26.148706 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:26.148929 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:26.148747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:26.148929 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.148877 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:26.148929 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.148885 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:26.148929 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.148940 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:34.14892327 +0000 UTC m=+18.036528401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:26.149590 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.148957 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:34.148949501 +0000 UTC m=+18.036554625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:26.350251 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:26.350198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:26.350447 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.350354 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:26.350447 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.350373 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:26.350447 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.350386 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:26.350590 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.350450 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:34.350433156 +0000 UTC m=+18.238038283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:26.534828 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:26.534685 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:26.535241 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:26.534940 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:26.535241 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.535179 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:26.535241 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:26.535210 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:27.532955 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:27.532910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:27.533429 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:27.533057 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:28.535481 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:28.535303 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:28.535481 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:28.535353 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:28.535481 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:28.535431 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:28.536044 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:28.535531 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:29.532792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:29.532755 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:29.532967 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:29.532908 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:30.532194 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:30.532176 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:30.532446 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:30.532276 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:30.532446 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:30.532357 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:30.532509 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:30.532465 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:31.532738 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:31.532707 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:31.533164 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:31.532830 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:32.532302 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:32.532258 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:32.532478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:32.532270 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:32.532478 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:32.532397 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:32.532595 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:32.532489 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:33.532416 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:33.532380 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:33.532885 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:33.532488 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:34.214279 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:34.214241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:34.214435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:34.214303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:34.214435 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.214402 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:34.214514 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.214476 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:50.214459801 +0000 UTC m=+34.102064925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:34.214514 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.214401 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:34.214587 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.214564 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:50.214545403 +0000 UTC m=+34.102150531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:34.415813 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:34.415762 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:34.415984 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.415961 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:34.416043 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.415992 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:34.416043 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.416005 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:34.416150 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.416068 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:19:50.416050254 +0000 UTC m=+34.303655383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:34.532387 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:34.532302 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:34.532538 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.532433 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:34.532538 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:34.532507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:34.532962 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:34.532616 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:35.533125 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:35.533094 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:35.533544 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:35.533222 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:36.533638 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:36.533607 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:36.534120 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:36.533711 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:36.534120 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:36.533833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:36.534120 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:36.533951 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:37.532615 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:37.532582 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:37.532856 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:37.532713 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:38.532506 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:38.532295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:38.532506 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:38.532423 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:38.532506 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:38.532503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:38.533138 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:38.532617 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:39.533284 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.533082 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:39.534114 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:39.533425 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:39.735685 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.735652 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mbjn4" event={"ID":"e6993041-e8d6-416f-b702-fdd8adc34b9e","Type":"ContainerStarted","Data":"431508d5dd8f8b4f60ab1bfdb9eb634dbc5ee571f2a67b060d14b260ec88a687"} Jun 11 16:19:39.737397 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.737370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" event={"ID":"875ae7c8-53d3-4297-b5a1-dd4587c45f02","Type":"ContainerStarted","Data":"62e20d291ef61edf58d4da23d9094965ce635fb5fa1aef432e483b0b44952d51"} Jun 11 16:19:39.740820 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.740780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"b002addf9b7d47d726242f554f9670be52204d20931b80c749f17e19f5aafcf3"} Jun 11 16:19:39.740950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.740854 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"a69468fc2884f6791cf8cd907e678a44a648bfa0dca7f2ac81fb20085605b4d3"} Jun 11 16:19:39.740950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.740902 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"a08de08da5a3c85f01751f3dca8c35b54f6911f3c6f6175459ebe54a2889432f"} Jun 11 16:19:39.740950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.740947 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"c01655fc09199797be3a4c3a39334638cd3317f134f7f8019bf59c209b4800df"} Jun 11 16:19:39.741119 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.740994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"7d1510c807abd2ea5976640cc7552283ad2777c2437607cfb748722532303c02"} Jun 11 16:19:39.741119 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.741040 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"742dd580041510b15de873ba75e7ef764a86a6d17935e8bf0ad3749d52df1e15"} Jun 11 16:19:39.742445 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.742421 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" event={"ID":"361bae7b-4994-4bcc-a66e-27b967508e7f","Type":"ContainerStarted","Data":"c9b6065a5e19c6b3a402477021cc80ee28ada3d0c8bdc2bec62c1856e7f6da08"} Jun 11 16:19:39.744035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.744009 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="f1ed18d68ad5598bbf2161a386c7df2a42ac485d15342079bf7eabae0bde2b7f" exitCode=0 Jun 11 16:19:39.744145 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.744097 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"f1ed18d68ad5598bbf2161a386c7df2a42ac485d15342079bf7eabae0bde2b7f"} Jun 11 16:19:39.745869 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.745842 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-99fkl" event={"ID":"5374ba43-7006-45fe-a566-301bd90a57e0","Type":"ContainerStarted","Data":"6aec02f28a9bce80b792f6795c2d090f5fc14a4320e320187f7b7aad1abda242"} Jun 11 16:19:39.747275 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.747252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvz7x" event={"ID":"cd07688a-2e63-4bc2-b93a-a576607255bc","Type":"ContainerStarted","Data":"903cd90561c0a1a5b683ded8726b5f4a04abd9599d7af48e806a3bf86be56361"} Jun 11 16:19:39.748858 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.748778 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9ktx7" event={"ID":"d63814e7-bf6f-456e-bd50-36c7656687f3","Type":"ContainerStarted","Data":"f2ffadfdce6f4f1775c776b703ee77edd20045b71009e3dee7e5ad1abcc766b8"} Jun 11 16:19:39.756621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.756575 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-49.ec2.internal" podStartSLOduration=22.756561353 podStartE2EDuration="22.756561353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:21.706625243 +0000 UTC m=+5.594230391" watchObservedRunningTime="2026-06-11 16:19:39.756561353 +0000 UTC m=+23.644166498" Jun 11 16:19:39.756968 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.756921 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mbjn4" podStartSLOduration=3.83856206 podStartE2EDuration="22.756912835s" totalImagesPullingTime="18.918350775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:39.756505788 +0000 UTC m=+23.644110933" watchObservedRunningTime="2026-06-11 16:19:39.756912835 +0000 UTC m=+23.644517983" Jun 11 16:19:39.773883 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.773826 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-99fkl" podStartSLOduration=4.848503587 podStartE2EDuration="23.77378955s" totalImagesPullingTime="18.925285963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:39.773675589 +0000 UTC m=+23.661280756" watchObservedRunningTime="2026-06-11 16:19:39.77378955 +0000 UTC m=+23.661394696" Jun 11 16:19:39.810447 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.810417 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:39.810919 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.810899 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:39.815621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.815581 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nvz7x" podStartSLOduration=8.078534984 podStartE2EDuration="22.815567517s" totalImagesPullingTime="14.737032533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:39.815307886 +0000 UTC m=+23.702913032" watchObservedRunningTime="2026-06-11 16:19:39.815567517 +0000 UTC m=+23.703172662" Jun 11 16:19:39.838493 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.838437 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xqxvm" podStartSLOduration=3.894254912 podStartE2EDuration="22.838420929s" totalImagesPullingTime="18.944166017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:39.837956846 +0000 UTC m=+23.725561991" watchObservedRunningTime="2026-06-11 16:19:39.838420929 +0000 UTC m=+23.726026077" Jun 11 16:19:39.859031 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:39.858986 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9ktx7" podStartSLOduration=3.84996616 podStartE2EDuration="22.858970111s" totalImagesPullingTime="19.009003951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:39.858767281 +0000 UTC m=+23.746372430" watchObservedRunningTime="2026-06-11 16:19:39.858970111 +0000 UTC m=+23.746575257" Jun 11 16:19:40.108641 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.108586 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:19:40.533177 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.532983 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:40.533177 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:40.533106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:40.533177 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.533036 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:19:40.108635208Z","UUID":"0e0a8c1f-265d-4e98-9dc5-3b04de934676","Handler":null,"Name":"","Endpoint":""} Jun 11 16:19:40.533177 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.533137 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:40.533987 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:40.533268 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:40.534838 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.534818 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:19:40.534949 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.534857 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:19:40.753544 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.753507 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" event={"ID":"875ae7c8-53d3-4297-b5a1-dd4587c45f02","Type":"ContainerStarted","Data":"f76957a818241f7ac6d41492e74442b275150a20ae1d13806fa681327c634010"} Jun 11 16:19:40.755321 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.755264 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxgxg" event={"ID":"abb5b5b1-0f16-46d5-a0a8-bbaf300ddaa7","Type":"ContainerStarted","Data":"f02e1fdf2f7960dbbb5df12567b8cb443219b4b88fe210a4d9cc16425b3312ad"} Jun 11 16:19:40.755930 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.755905 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:40.756443 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.756418 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nvz7x" Jun 11 16:19:40.798721 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:40.798611 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dxgxg" podStartSLOduration=5.867593035 podStartE2EDuration="24.79859331s" totalImagesPullingTime="18.931000275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:40.778309879 +0000 UTC m=+24.665915024" watchObservedRunningTime="2026-06-11 16:19:40.79859331 +0000 UTC m=+24.686198456" Jun 11 16:19:41.532137 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:41.532061 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:41.532267 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:41.532172 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:41.760306 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:41.760254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" event={"ID":"875ae7c8-53d3-4297-b5a1-dd4587c45f02","Type":"ContainerStarted","Data":"4ae1dd167f81151c8ea40c94d07e242fe8053eab91c6322261e13e171727d1bf"} Jun 11 16:19:41.763998 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:41.763970 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"a87c2db81a7140a55dfcc5f03bd0e9f980ab707ae2e63c5c9a05c4b260a24850"} Jun 11 16:19:41.782403 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:41.782327 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9szh" podStartSLOduration=3.614914652 podStartE2EDuration="24.782313704s" totalImagesPullingTime="21.167399052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:41.781695493 +0000 UTC m=+25.669300639" watchObservedRunningTime="2026-06-11 16:19:41.782313704 +0000 UTC m=+25.669918892" Jun 11 16:19:42.533221 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:42.533047 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:42.533423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:42.533105 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:42.533423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:42.533337 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:42.533423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:42.533403 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:43.532818 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:43.532771 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:43.533345 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:43.532927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:44.533314 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.533084 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:44.534011 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.533152 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:44.534011 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:44.533366 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:44.534011 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:44.533446 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:44.774233 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.774200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" event={"ID":"3aa98384-4c4e-42cf-903b-39f1f04bd265","Type":"ContainerStarted","Data":"688cf071b849c5edb2826a259f017b22bf2fa58cda24be61e71cf24a35bd39a9"} Jun 11 16:19:44.774413 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.774400 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:44.774484 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.774460 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:44.776154 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.776126 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="b273182991d043d4e15076a3f8ca21c6d67b37189d09c8f2e2f6398d7f85a0e9" exitCode=0 Jun 11 16:19:44.776368 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.776167 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"b273182991d043d4e15076a3f8ca21c6d67b37189d09c8f2e2f6398d7f85a0e9"} Jun 11 16:19:44.789768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.789717 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:44.814184 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:44.814142 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" podStartSLOduration=8.814721598 podStartE2EDuration="27.81412967s" totalImagesPullingTime="18.999408072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:44.81384077 +0000 UTC m=+28.701445916" watchObservedRunningTime="2026-06-11 16:19:44.81412967 +0000 UTC m=+28.701734815" Jun 11 16:19:45.532565 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:45.532529 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:45.532794 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:45.532673 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:45.779210 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:45.779175 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:45.795150 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:45.795078 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:19:46.182325 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.182283 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfcw7"] Jun 11 16:19:46.182488 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.182409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:46.182534 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:46.182493 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:46.185452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.185424 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-crrdf"] Jun 11 16:19:46.185578 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.185520 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:46.185630 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:46.185597 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:46.192340 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.192314 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hc4dt"] Jun 11 16:19:46.192476 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.192424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:46.192556 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:46.192534 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:46.783462 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.783430 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="d8e7c39de2237bf640f3e0f97d4d92f5795bcf575421435a5ffe7f565df51277" exitCode=0 Jun 11 16:19:46.783857 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:46.783524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"d8e7c39de2237bf640f3e0f97d4d92f5795bcf575421435a5ffe7f565df51277"} Jun 11 16:19:47.533028 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:47.532990 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:47.533201 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:47.533030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:47.533201 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:47.533122 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:47.533314 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:47.533264 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:48.532498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:48.532332 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:48.532917 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:48.532581 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:48.790550 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:48.790461 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="052aed765763d4294765709dad137f40463997eb244dda0f7e86c92c53846f57" exitCode=0 Jun 11 16:19:48.790550 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:48.790514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"052aed765763d4294765709dad137f40463997eb244dda0f7e86c92c53846f57"} Jun 11 16:19:49.532154 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:49.532121 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:49.532313 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:49.532257 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crrdf" podUID="caf2e313-c9de-42f7-901b-cc83af612fa8" Jun 11 16:19:49.532381 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:49.532306 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:49.532448 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:49.532426 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfcw7" podUID="400156e2-254a-4dc4-a7e2-f0e0f9ac81aa" Jun 11 16:19:50.233324 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:50.233280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:50.233915 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:50.233345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:50.233915 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.233458 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:50.233915 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.233462 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:50.233915 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.233520 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret podName:caf2e313-c9de-42f7-901b-cc83af612fa8 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:22.233502414 +0000 UTC m=+66.121107561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret") pod "global-pull-secret-syncer-crrdf" (UID: "caf2e313-c9de-42f7-901b-cc83af612fa8") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:50.233915 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.233538 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:22.233530591 +0000 UTC m=+66.121135716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:50.435077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:50.435041 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:50.435297 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.435279 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:50.435363 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.435303 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:50.435363 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.435313 2557 projected.go:196] Error preparing data for projected volume kube-api-access-2df2t for pod openshift-network-diagnostics/network-check-target-sfcw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:50.435436 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.435370 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t podName:400156e2-254a-4dc4-a7e2-f0e0f9ac81aa nodeName:}" failed. No retries permitted until 2026-06-11 16:20:22.435351087 +0000 UTC m=+66.322956210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2df2t" (UniqueName: "kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t") pod "network-check-target-sfcw7" (UID: "400156e2-254a-4dc4-a7e2-f0e0f9ac81aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:50.532649 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:50.532567 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:50.532832 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:50.532707 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hc4dt" podUID="82a4dcc6-86f8-4a17-b32b-6166ff650641" Jun 11 16:19:51.487488 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.487412 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-49.ec2.internal" event="NodeReady" Jun 11 16:19:51.488044 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.487590 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:19:51.526939 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.526904 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-674f7c46f9-79mm5"] Jun 11 16:19:51.529199 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.529177 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.531499 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.531463 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:19:51.531655 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.531582 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tsn7d\"" Jun 11 16:19:51.531839 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.531816 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:19:51.531962 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.531891 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:19:51.532138 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.532090 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:19:51.532138 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.532104 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:19:51.535017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.534994 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:19:51.535017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.535013 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:19:51.535197 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.535023 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chc72\"" Jun 11 16:19:51.535497 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.535463 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:19:51.538624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.538471 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:19:51.542531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.542507 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s9rpw"] Jun 11 16:19:51.544753 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.544715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.545542 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.545489 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-674f7c46f9-79mm5"] Jun 11 16:19:51.546351 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.546335 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-29b7p"] Jun 11 16:19:51.547219 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.547127 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmgzf\"" Jun 11 16:19:51.547315 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.547272 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:19:51.547474 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.547458 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:19:51.548134 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.548114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.550643 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.550180 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nqb2b\"" Jun 11 16:19:51.550643 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.550218 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:19:51.550643 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.550259 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:19:51.550643 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.550427 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:19:51.556303 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.556152 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9rpw"] Jun 11 16:19:51.562539 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.562507 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29b7p"] Jun 11 16:19:51.643480 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643446 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-cert\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.643654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643556 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad08e4e-4cfe-4420-a071-6210f76d154c-tmp-dir\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.643884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwh5h\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643852 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.643884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643879 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wc5\" (UniqueName: \"kubernetes.io/projected/aad08e4e-4cfe-4420-a071-6210f76d154c-kube-api-access-m6wc5\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.644089 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aad08e4e-4cfe-4420-a071-6210f76d154c-config-volume\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.644089 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.644089 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.643983 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gvh\" (UniqueName: \"kubernetes.io/projected/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-kube-api-access-84gvh\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.644089 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.644008 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.703266 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.703224 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nvz7x_cd07688a-2e63-4bc2-b93a-a576607255bc/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.745285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwh5h\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745308 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wc5\" (UniqueName: \"kubernetes.io/projected/aad08e4e-4cfe-4420-a071-6210f76d154c-kube-api-access-m6wc5\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.745567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aad08e4e-4cfe-4420-a071-6210f76d154c-config-volume\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.745567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.745567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745527 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gvh\" (UniqueName: \"kubernetes.io/projected/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-kube-api-access-84gvh\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.745567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-cert\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745729 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.745824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad08e4e-4cfe-4420-a071-6210f76d154c-tmp-dir\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.746171 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:51.745882 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:19:51.746171 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:51.745950 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:52.245933383 +0000 UTC m=+36.133538508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:19:51.746171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.745994 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.746171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.746080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad08e4e-4cfe-4420-a071-6210f76d154c-tmp-dir\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.746171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.746084 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aad08e4e-4cfe-4420-a071-6210f76d154c-config-volume\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.746413 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:51.746183 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:19:51.746413 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:51.746197 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:19:51.746413 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:51.746252 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:52.246237393 +0000 UTC m=+36.133842531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:19:51.746413 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.746292 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.747059 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.747035 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.750531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.750490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.750531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.750507 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.750677 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.750513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-cert\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.753997 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.753946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwh5h\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.755993 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.755969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gvh\" (UniqueName: \"kubernetes.io/projected/2aaa2106-93ab-4ae7-9f3e-78d493c63f20-kube-api-access-84gvh\") pod \"ingress-canary-29b7p\" (UID: \"2aaa2106-93ab-4ae7-9f3e-78d493c63f20\") " pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:51.756092 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.756050 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wc5\" (UniqueName: \"kubernetes.io/projected/aad08e4e-4cfe-4420-a071-6210f76d154c-kube-api-access-m6wc5\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:51.756420 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.756399 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:51.788219 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.788185 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nvz7x_cd07688a-2e63-4bc2-b93a-a576607255bc/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.875029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:51.874760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29b7p" Jun 11 16:19:52.249488 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.249447 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:52.249652 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.249523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:52.249652 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:52.249627 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:19:52.249652 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:52.249635 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:19:52.249849 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:52.249657 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:19:52.249849 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:52.249687 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:53.249669287 +0000 UTC m=+37.137274421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:19:52.249849 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:52.249716 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:53.249695698 +0000 UTC m=+37.137300830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:19:52.532681 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.532593 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:19:52.535162 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.535130 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmdjj\"" Jun 11 16:19:52.535305 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.535170 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:19:52.736675 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.736649 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29b7p"] Jun 11 16:19:52.742718 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:19:52.742695 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aaa2106_93ab_4ae7_9f3e_78d493c63f20.slice/crio-6648565cb5892ac91764de7736e744367dfe90e360bac9af3b2ba8baa64d9788 WatchSource:0}: Error finding container 6648565cb5892ac91764de7736e744367dfe90e360bac9af3b2ba8baa64d9788: Status 404 returned error can't find the container with id 6648565cb5892ac91764de7736e744367dfe90e360bac9af3b2ba8baa64d9788 Jun 11 16:19:52.803341 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.803238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerStarted","Data":"2b8013f07bd7bd9e3c47891c16d77950a4ffb40cb512a71273979b13e4b39f60"} Jun 11 16:19:52.804332 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:52.804308 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29b7p" event={"ID":"2aaa2106-93ab-4ae7-9f3e-78d493c63f20","Type":"ContainerStarted","Data":"6648565cb5892ac91764de7736e744367dfe90e360bac9af3b2ba8baa64d9788"} Jun 11 16:19:53.256020 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:53.255988 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:53.256163 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:53.256053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:53.256163 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:53.256141 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:19:53.256163 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:53.256147 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:19:53.256277 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:53.256168 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:19:53.256277 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:53.256202 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:55.256186285 +0000 UTC m=+39.143791424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:19:53.256277 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:53.256215 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:55.256209607 +0000 UTC m=+39.143814730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:19:53.809579 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:53.809551 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="2b8013f07bd7bd9e3c47891c16d77950a4ffb40cb512a71273979b13e4b39f60" exitCode=0 Jun 11 16:19:53.810029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:53.809593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"2b8013f07bd7bd9e3c47891c16d77950a4ffb40cb512a71273979b13e4b39f60"} Jun 11 16:19:54.815502 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:54.815469 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a2f847a-eae6-4648-b8bd-cdb3e0274c3c" containerID="644c3c4f322d02ae5adf3de073b13ffa02936dbc17825675a53f9868f398afef" exitCode=0 Jun 11 16:19:54.815917 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:54.815514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerDied","Data":"644c3c4f322d02ae5adf3de073b13ffa02936dbc17825675a53f9868f398afef"} Jun 11 16:19:55.272302 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.272110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:55.272441 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.272347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:55.272441 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:55.272271 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:19:55.272534 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:55.272441 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:59.272422051 +0000 UTC m=+43.160027180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:19:55.272534 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:55.272494 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:19:55.272534 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:55.272508 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:19:55.272630 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:55.272550 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:19:59.272538482 +0000 UTC m=+43.160143625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:19:55.820736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.820695 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" event={"ID":"3a2f847a-eae6-4648-b8bd-cdb3e0274c3c","Type":"ContainerStarted","Data":"ac40b06ddeab0c2fd4f5ef0d57e3d8c8752ec5808cf765173b38b1d2dc9b6b35"} Jun 11 16:19:55.822196 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.822172 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29b7p" event={"ID":"2aaa2106-93ab-4ae7-9f3e-78d493c63f20","Type":"ContainerStarted","Data":"e5efcdeb897e0807170b1b6d6ef6d1ad5b8a959ac57a1922670949cf1bd80921"} Jun 11 16:19:55.844537 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.844480 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cwhdk" podStartSLOduration=10.745613399 podStartE2EDuration="39.844462131s" totalImagesPullingTime="29.098848732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:55.843627888 +0000 UTC m=+39.731233038" watchObservedRunningTime="2026-06-11 16:19:55.844462131 +0000 UTC m=+39.732067277" Jun 11 16:19:55.862305 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:55.862260 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-29b7p" podStartSLOduration=2.604549254 podStartE2EDuration="4.862243062s" totalImagesPullingTime="2.257693808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:55.861700662 +0000 UTC m=+39.749305834" watchObservedRunningTime="2026-06-11 16:19:55.862243062 +0000 UTC m=+39.749848208" Jun 11 16:19:59.301525 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:59.301485 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:19:59.301623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:59.301630 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:59.301650 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:59.301700 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:07.301685932 +0000 UTC m=+51.189291056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:59.301707 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:19:59.301940 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:19:59.301744 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:07.30173399 +0000 UTC m=+51.189339115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:20:07.360987 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:07.360942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:07.361016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:07.361099 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:07.361120 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:07.361172 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:23.361156745 +0000 UTC m=+67.248761870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:07.361120 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:07.361423 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:07.361238 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:23.361225881 +0000 UTC m=+67.248831005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:20:17.796037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:17.796007 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94znb" Jun 11 16:20:22.265762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.265702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:20:22.265762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.265765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:20:22.270025 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.270000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:20:22.270126 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.270025 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:20:22.276171 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:22.276145 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:20:22.276232 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:22.276217 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs podName:82a4dcc6-86f8-4a17-b32b-6166ff650641 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:26.276199036 +0000 UTC m=+130.163804163 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs") pod "network-metrics-daemon-hc4dt" (UID: "82a4dcc6-86f8-4a17-b32b-6166ff650641") : secret "metrics-daemon-secret" not found Jun 11 16:20:22.279744 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.279721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/caf2e313-c9de-42f7-901b-cc83af612fa8-original-pull-secret\") pod \"global-pull-secret-syncer-crrdf\" (UID: \"caf2e313-c9de-42f7-901b-cc83af612fa8\") " pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:20:22.460070 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.460021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crrdf" Jun 11 16:20:22.467627 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.467600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:20:22.470831 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.470810 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:20:22.480983 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.480958 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:20:22.491038 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.491001 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2df2t\" (UniqueName: \"kubernetes.io/projected/400156e2-254a-4dc4-a7e2-f0e0f9ac81aa-kube-api-access-2df2t\") pod \"network-check-target-sfcw7\" (UID: \"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa\") " pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:20:22.588615 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.588582 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-crrdf"] Jun 11 16:20:22.592127 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:20:22.592099 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf2e313_c9de_42f7_901b_cc83af612fa8.slice/crio-e4e1fd2a4871527d32bf7b5417d1ef374cb701fdf16257416703f5cb6cdbdfef WatchSource:0}: Error finding container e4e1fd2a4871527d32bf7b5417d1ef374cb701fdf16257416703f5cb6cdbdfef: Status 404 returned error can't find the container with id e4e1fd2a4871527d32bf7b5417d1ef374cb701fdf16257416703f5cb6cdbdfef Jun 11 16:20:22.753063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.753030 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chc72\"" Jun 11 16:20:22.761251 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.761222 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:20:22.885468 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.885422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-crrdf" event={"ID":"caf2e313-c9de-42f7-901b-cc83af612fa8","Type":"ContainerStarted","Data":"e4e1fd2a4871527d32bf7b5417d1ef374cb701fdf16257416703f5cb6cdbdfef"} Jun 11 16:20:22.908357 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:22.908325 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfcw7"] Jun 11 16:20:22.911296 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:20:22.911268 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400156e2_254a_4dc4_a7e2_f0e0f9ac81aa.slice/crio-31dbf2290ef3ba31dfe1c2195f90b625dce8f4b3dfc1923c5a57e129bbca9c51 WatchSource:0}: Error finding container 31dbf2290ef3ba31dfe1c2195f90b625dce8f4b3dfc1923c5a57e129bbca9c51: Status 404 returned error can't find the container with id 31dbf2290ef3ba31dfe1c2195f90b625dce8f4b3dfc1923c5a57e129bbca9c51 Jun 11 16:20:23.374727 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:23.374496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:20:23.374727 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:23.374585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:20:23.374727 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:23.374638 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:23.374727 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:23.374713 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:55.37469285 +0000 UTC m=+99.262297977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:20:23.374727 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:23.374729 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:23.375604 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:23.374744 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:20:23.375604 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:23.374791 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:55.374776761 +0000 UTC m=+99.262381885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:20:23.890267 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:23.890231 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfcw7" event={"ID":"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa","Type":"ContainerStarted","Data":"31dbf2290ef3ba31dfe1c2195f90b625dce8f4b3dfc1923c5a57e129bbca9c51"} Jun 11 16:20:27.902524 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:27.902482 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-crrdf" event={"ID":"caf2e313-c9de-42f7-901b-cc83af612fa8","Type":"ContainerStarted","Data":"22f75315484de3a8c635ace2ce73f089ea9fd646dc6bab38f56a076c03c8bd91"} Jun 11 16:20:27.903959 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:27.903934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfcw7" event={"ID":"400156e2-254a-4dc4-a7e2-f0e0f9ac81aa","Type":"ContainerStarted","Data":"b1eec491ee08cd40bb964dad5d39668581e3741e8a574d1ad9a18f6b7f4f13d1"} Jun 11 16:20:27.904078 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:27.904064 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:20:27.918503 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:27.918387 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-crrdf" podStartSLOduration=65.814312314 podStartE2EDuration="1m10.918371042s" totalImagesPullingTime="5.104058728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:27.918098004 +0000 UTC m=+71.805703150" watchObservedRunningTime="2026-06-11 16:20:27.918371042 +0000 UTC m=+71.805976189" Jun 11 16:20:27.935695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:27.935648 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sfcw7" podStartSLOduration=66.162349737 podStartE2EDuration="1m10.93563443s" totalImagesPullingTime="4.773284693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:27.934969405 +0000 UTC m=+71.822574555" watchObservedRunningTime="2026-06-11 16:20:27.93563443 +0000 UTC m=+71.823239575" Jun 11 16:20:51.795255 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.795218 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc"] Jun 11 16:20:51.798135 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.798112 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:51.800408 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.800382 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 16:20:51.801051 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.801027 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k79h5\"" Jun 11 16:20:51.801051 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.801039 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 16:20:51.801200 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.801097 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:20:51.810737 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.810717 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc"] Jun 11 16:20:51.890149 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.890091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:51.890336 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.890190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxgx\" (UniqueName: \"kubernetes.io/projected/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-kube-api-access-5fxgx\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:51.906485 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.906458 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw"] Jun 11 16:20:51.908292 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.908277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:51.910442 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.910418 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 16:20:51.910563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.910421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 16:20:51.910563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.910539 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-48r9l\"" Jun 11 16:20:51.910563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.910557 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 16:20:51.910788 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.910771 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:20:51.928266 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.928241 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw"] Jun 11 16:20:51.990864 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.990826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df462b57-feae-48cc-958d-292f5d24466c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:51.990864 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.990862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drbr\" (UniqueName: \"kubernetes.io/projected/df462b57-feae-48cc-958d-292f5d24466c-kube-api-access-7drbr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:51.991107 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.990889 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df462b57-feae-48cc-958d-292f5d24466c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:51.991107 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.990934 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxgx\" (UniqueName: \"kubernetes.io/projected/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-kube-api-access-5fxgx\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:51.991107 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:51.990968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:51.991107 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:51.991061 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:20:51.991296 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:51.991115 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls podName:66aaaaea-3ef3-452a-bca1-e3425a7cc1c9 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:52.491102722 +0000 UTC m=+96.378707845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hqdjc" (UID: "66aaaaea-3ef3-452a-bca1-e3425a7cc1c9") : secret "samples-operator-tls" not found Jun 11 16:20:52.001533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.001501 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr"] Jun 11 16:20:52.003331 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.003313 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" Jun 11 16:20:52.005950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.005931 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:20:52.006071 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.005989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dhdbr\"" Jun 11 16:20:52.006071 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.006024 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 16:20:52.019927 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.019899 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr"] Jun 11 16:20:52.022640 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.022620 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxgx\" (UniqueName: \"kubernetes.io/projected/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-kube-api-access-5fxgx\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:52.092052 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.091945 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df462b57-feae-48cc-958d-292f5d24466c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.092052 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.091994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drbr\" (UniqueName: \"kubernetes.io/projected/df462b57-feae-48cc-958d-292f5d24466c-kube-api-access-7drbr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.092244 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.092123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df462b57-feae-48cc-958d-292f5d24466c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.092244 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.092192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64s6p\" (UniqueName: \"kubernetes.io/projected/4e5c0c70-eb89-4c7d-9011-14e2535c2898-kube-api-access-64s6p\") pod \"volume-data-source-validator-78dd696465-ffbdr\" (UID: \"4e5c0c70-eb89-4c7d-9011-14e2535c2898\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" Jun 11 16:20:52.092545 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.092526 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df462b57-feae-48cc-958d-292f5d24466c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.094276 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.094251 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df462b57-feae-48cc-958d-292f5d24466c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.102785 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.102765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drbr\" (UniqueName: \"kubernetes.io/projected/df462b57-feae-48cc-958d-292f5d24466c-kube-api-access-7drbr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrfgw\" (UID: \"df462b57-feae-48cc-958d-292f5d24466c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.193496 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.193447 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64s6p\" (UniqueName: \"kubernetes.io/projected/4e5c0c70-eb89-4c7d-9011-14e2535c2898-kube-api-access-64s6p\") pod \"volume-data-source-validator-78dd696465-ffbdr\" (UID: \"4e5c0c70-eb89-4c7d-9011-14e2535c2898\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" Jun 11 16:20:52.203855 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.203822 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64s6p\" (UniqueName: \"kubernetes.io/projected/4e5c0c70-eb89-4c7d-9011-14e2535c2898-kube-api-access-64s6p\") pod \"volume-data-source-validator-78dd696465-ffbdr\" (UID: \"4e5c0c70-eb89-4c7d-9011-14e2535c2898\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" Jun 11 16:20:52.216405 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.216381 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" Jun 11 16:20:52.311440 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.311411 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" Jun 11 16:20:52.338201 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.338169 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw"] Jun 11 16:20:52.340986 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:20:52.340958 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf462b57_feae_48cc_958d_292f5d24466c.slice/crio-4318399bd46f15938ebbe5f83a40a6a1d723cb132fe014bdb3385688aa0d3ff4 WatchSource:0}: Error finding container 4318399bd46f15938ebbe5f83a40a6a1d723cb132fe014bdb3385688aa0d3ff4: Status 404 returned error can't find the container with id 4318399bd46f15938ebbe5f83a40a6a1d723cb132fe014bdb3385688aa0d3ff4 Jun 11 16:20:52.434279 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.434248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr"] Jun 11 16:20:52.437538 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:20:52.437512 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5c0c70_eb89_4c7d_9011_14e2535c2898.slice/crio-3da941c0bb00498b7ac700cf3f68b65178c6c541e5196b04589e1d02e5974649 WatchSource:0}: Error finding container 3da941c0bb00498b7ac700cf3f68b65178c6c541e5196b04589e1d02e5974649: Status 404 returned error can't find the container with id 3da941c0bb00498b7ac700cf3f68b65178c6c541e5196b04589e1d02e5974649 Jun 11 16:20:52.495694 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.495656 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:52.495880 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:52.495828 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:20:52.495928 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:52.495896 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls podName:66aaaaea-3ef3-452a-bca1-e3425a7cc1c9 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:53.495881065 +0000 UTC m=+97.383486189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hqdjc" (UID: "66aaaaea-3ef3-452a-bca1-e3425a7cc1c9") : secret "samples-operator-tls" not found Jun 11 16:20:52.967404 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.967364 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" event={"ID":"df462b57-feae-48cc-958d-292f5d24466c","Type":"ContainerStarted","Data":"4318399bd46f15938ebbe5f83a40a6a1d723cb132fe014bdb3385688aa0d3ff4"} Jun 11 16:20:52.968500 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:52.968477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" event={"ID":"4e5c0c70-eb89-4c7d-9011-14e2535c2898","Type":"ContainerStarted","Data":"3da941c0bb00498b7ac700cf3f68b65178c6c541e5196b04589e1d02e5974649"} Jun 11 16:20:53.504014 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:53.503969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:53.504196 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:53.504171 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:20:53.504273 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:53.504259 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls podName:66aaaaea-3ef3-452a-bca1-e3425a7cc1c9 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:55.504236408 +0000 UTC m=+99.391841566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hqdjc" (UID: "66aaaaea-3ef3-452a-bca1-e3425a7cc1c9") : secret "samples-operator-tls" not found Jun 11 16:20:53.972413 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:53.972380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" event={"ID":"4e5c0c70-eb89-4c7d-9011-14e2535c2898","Type":"ContainerStarted","Data":"52f396abbb647926977faac892bbfff8202cb3c98d94ab3cc5f353f253d64cb5"} Jun 11 16:20:53.990021 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:53.989957 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ffbdr" podStartSLOduration=1.883396984 podStartE2EDuration="2.989941354s" totalImagesPullingTime="1.10654437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:53.989705671 +0000 UTC m=+97.877310821" watchObservedRunningTime="2026-06-11 16:20:53.989941354 +0000 UTC m=+97.877546494" Jun 11 16:20:54.977099 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:54.977065 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" event={"ID":"df462b57-feae-48cc-958d-292f5d24466c","Type":"ContainerStarted","Data":"38c8573e267d374d8579bf8133f8a33fd7f245df3445a152a9202b987ff1fa08"} Jun 11 16:20:54.995232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:54.995186 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" podStartSLOduration=1.904018628 podStartE2EDuration="3.995171037s" totalImagesPullingTime="2.091152409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:54.9940072 +0000 UTC m=+98.881612346" watchObservedRunningTime="2026-06-11 16:20:54.995171037 +0000 UTC m=+98.882776182" Jun 11 16:20:55.417183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:55.417145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:20:55.417365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:55.417219 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") pod \"image-registry-674f7c46f9-79mm5\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:20:55.417365 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.417299 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:55.417365 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.417331 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:20:55.417365 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.417343 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-674f7c46f9-79mm5: secret "image-registry-tls" not found Jun 11 16:20:55.417502 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.417368 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls podName:aad08e4e-4cfe-4420-a071-6210f76d154c nodeName:}" failed. No retries permitted until 2026-06-11 16:21:59.417349365 +0000 UTC m=+163.304954508 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls") pod "dns-default-s9rpw" (UID: "aad08e4e-4cfe-4420-a071-6210f76d154c") : secret "dns-default-metrics-tls" not found Jun 11 16:20:55.417502 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.417394 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls podName:74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:59.417376356 +0000 UTC m=+163.304981485 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls") pod "image-registry-674f7c46f9-79mm5" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4") : secret "image-registry-tls" not found Jun 11 16:20:55.518077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:55.518037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:55.518239 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.518187 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:20:55.518278 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:55.518262 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls podName:66aaaaea-3ef3-452a-bca1-e3425a7cc1c9 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:59.518243005 +0000 UTC m=+103.405848140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hqdjc" (UID: "66aaaaea-3ef3-452a-bca1-e3425a7cc1c9") : secret "samples-operator-tls" not found Jun 11 16:20:57.229163 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:57.229138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mbjn4_e6993041-e8d6-416f-b702-fdd8adc34b9e/dns-node-resolver/0.log" Jun 11 16:20:58.029231 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:58.029204 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-99fkl_5374ba43-7006-45fe-a566-301bd90a57e0/node-ca/0.log" Jun 11 16:20:58.829079 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:58.829048 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29b7p_2aaa2106-93ab-4ae7-9f3e-78d493c63f20/serve-healthcheck-canary/0.log" Jun 11 16:20:58.908373 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:58.908348 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sfcw7" Jun 11 16:20:59.075762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.075731 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jbbrz"] Jun 11 16:20:59.107967 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.107887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jbbrz"] Jun 11 16:20:59.108108 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.108004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.110285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.110261 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 16:20:59.110431 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.110261 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 16:20:59.110431 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.110320 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 16:20:59.110552 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.110539 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 16:20:59.110673 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.110657 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k4lgk\"" Jun 11 16:20:59.243666 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.243623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-key\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.243666 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.243666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qm4q\" (UniqueName: \"kubernetes.io/projected/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-kube-api-access-6qm4q\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.243897 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.243738 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-cabundle\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.344240 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.344199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-key\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.344240 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.344237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qm4q\" (UniqueName: \"kubernetes.io/projected/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-kube-api-access-6qm4q\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.344454 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.344279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-cabundle\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.344889 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.344872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-cabundle\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.346687 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.346666 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-signing-key\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.352769 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.352739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qm4q\" (UniqueName: \"kubernetes.io/projected/8d143d4d-fd78-4e1f-9ffd-2d788479ce3b-kube-api-access-6qm4q\") pod \"service-ca-7d74d578b8-jbbrz\" (UID: \"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b\") " pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.417085 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.417047 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" Jun 11 16:20:59.545997 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.545960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:20:59.546158 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:59.546109 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:20:59.546207 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:20:59.546190 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls podName:66aaaaea-3ef3-452a-bca1-e3425a7cc1c9 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:07.546171995 +0000 UTC m=+111.433777118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hqdjc" (UID: "66aaaaea-3ef3-452a-bca1-e3425a7cc1c9") : secret "samples-operator-tls" not found Jun 11 16:20:59.553650 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.553622 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-jbbrz"] Jun 11 16:20:59.567071 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:20:59.567043 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d143d4d_fd78_4e1f_9ffd_2d788479ce3b.slice/crio-7706dd9cacb61007d6442d916e47ca4d5d460af36594941713e7d34490ee055b WatchSource:0}: Error finding container 7706dd9cacb61007d6442d916e47ca4d5d460af36594941713e7d34490ee055b: Status 404 returned error can't find the container with id 7706dd9cacb61007d6442d916e47ca4d5d460af36594941713e7d34490ee055b Jun 11 16:20:59.989743 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:20:59.989708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" event={"ID":"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b","Type":"ContainerStarted","Data":"7706dd9cacb61007d6442d916e47ca4d5d460af36594941713e7d34490ee055b"} Jun 11 16:21:03.002330 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:03.002292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" event={"ID":"8d143d4d-fd78-4e1f-9ffd-2d788479ce3b","Type":"ContainerStarted","Data":"6dcbcc9a645e3607fe4e3f0fbbb9885770ca69f5c35a1ec50182540d6b8dfe92"} Jun 11 16:21:03.019360 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:03.019306 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-jbbrz" podStartSLOduration=1.061161872 podStartE2EDuration="4.019291043s" totalImagesPullingTime="2.958129171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:03.019146351 +0000 UTC m=+106.906751496" watchObservedRunningTime="2026-06-11 16:21:03.019291043 +0000 UTC m=+106.906896188" Jun 11 16:21:07.607685 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:07.607627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:21:07.610240 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:07.610216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66aaaaea-3ef3-452a-bca1-e3425a7cc1c9-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hqdjc\" (UID: \"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:21:07.707040 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:07.706984 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" Jun 11 16:21:07.845613 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:07.845578 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc"] Jun 11 16:21:08.018345 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:08.018300 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" event={"ID":"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9","Type":"ContainerStarted","Data":"a43763ed2732fa369260da53a2c174207c61e2e1b0626ec7643b21016148b349"} Jun 11 16:21:10.027141 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:10.027107 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" event={"ID":"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9","Type":"ContainerStarted","Data":"0b0a0104302bf3ea52608bddb4017eac115c007eeaca73fddbe12aacc22f5548"} Jun 11 16:21:10.027549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:10.027158 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" event={"ID":"66aaaaea-3ef3-452a-bca1-e3425a7cc1c9","Type":"ContainerStarted","Data":"dc57a0bca8cf3595e52cae7b8f20ad90db2563625e8e296b0c061a74d650f9c2"} Jun 11 16:21:10.057271 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:10.057220 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hqdjc" podStartSLOduration=17.687756536 podStartE2EDuration="19.057202016s" totalImagesPullingTime="1.36944548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:10.056792619 +0000 UTC m=+113.944397764" watchObservedRunningTime="2026-06-11 16:21:10.057202016 +0000 UTC m=+113.944807161" Jun 11 16:21:20.658855 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.658819 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m2j98"] Jun 11 16:21:20.660968 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.660953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.664934 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.664913 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:21:20.665055 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.664988 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:21:20.665662 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.665640 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:21:20.665762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.665718 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:21:20.665836 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.665768 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg9zq\"" Jun 11 16:21:20.688420 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.688395 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m2j98"] Jun 11 16:21:20.711940 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.711920 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr"] Jun 11 16:21:20.713905 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.713887 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" Jun 11 16:21:20.722171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.722152 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q"] Jun 11 16:21:20.722935 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.722921 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fg4kq\"" Jun 11 16:21:20.723955 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.723942 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:20.726085 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.726067 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:21:20.726198 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.726132 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:21:20.726775 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.726757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-659lh\"" Jun 11 16:21:20.726900 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.726760 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:21:20.726900 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.726841 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 16:21:20.735090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.735069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr"] Jun 11 16:21:20.744672 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.744654 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q"] Jun 11 16:21:20.801307 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.801278 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf"] Jun 11 16:21:20.803609 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.803594 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:20.805996 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.805979 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 16:21:20.806212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.806193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bsdm5\"" Jun 11 16:21:20.806296 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.806212 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 16:21:20.811204 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.811285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b20ee4-7d53-453d-b606-80d96ca2c9e7-crio-socket\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.811285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b20ee4-7d53-453d-b606-80d96ca2c9e7-data-volume\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.811357 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b20ee4-7d53-453d-b606-80d96ca2c9e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.811390 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th45d\" (UniqueName: \"kubernetes.io/projected/37b56a4d-37d8-49e2-80be-cc8842e7ecf3-kube-api-access-th45d\") pod \"network-check-source-dbd9cf844-wkhwr\" (UID: \"37b56a4d-37d8-49e2-80be-cc8842e7ecf3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" Jun 11 16:21:20.811390 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.811387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwlxg\" (UniqueName: \"kubernetes.io/projected/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-api-access-lwlxg\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.815667 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.815647 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-tc4wt"] Jun 11 16:21:20.817630 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.817610 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf"] Jun 11 16:21:20.817708 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.817702 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:20.820098 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.820079 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hc9t8\"" Jun 11 16:21:20.820192 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.820148 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:21:20.820744 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.820723 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:21:20.836941 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.836917 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tc4wt"] Jun 11 16:21:20.912059 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.911988 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912059 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:20.912232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:20.912232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:20.912232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b20ee4-7d53-453d-b606-80d96ca2c9e7-crio-socket\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b20ee4-7d53-453d-b606-80d96ca2c9e7-data-volume\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912201 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b20ee4-7d53-453d-b606-80d96ca2c9e7-crio-socket\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912230 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b20ee4-7d53-453d-b606-80d96ca2c9e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912257 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrt8\" (UniqueName: \"kubernetes.io/projected/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-kube-api-access-8zrt8\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:20.912435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912287 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th45d\" (UniqueName: \"kubernetes.io/projected/37b56a4d-37d8-49e2-80be-cc8842e7ecf3-kube-api-access-th45d\") pod \"network-check-source-dbd9cf844-wkhwr\" (UID: \"37b56a4d-37d8-49e2-80be-cc8842e7ecf3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" Jun 11 16:21:20.912435 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwlxg\" (UniqueName: \"kubernetes.io/projected/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-api-access-lwlxg\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912415 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b20ee4-7d53-453d-b606-80d96ca2c9e7-data-volume\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.912641 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.912618 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.914566 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.914544 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b20ee4-7d53-453d-b606-80d96ca2c9e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.927637 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.927608 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th45d\" (UniqueName: \"kubernetes.io/projected/37b56a4d-37d8-49e2-80be-cc8842e7ecf3-kube-api-access-th45d\") pod \"network-check-source-dbd9cf844-wkhwr\" (UID: \"37b56a4d-37d8-49e2-80be-cc8842e7ecf3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" Jun 11 16:21:20.927899 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.927882 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwlxg\" (UniqueName: \"kubernetes.io/projected/26b20ee4-7d53-453d-b606-80d96ca2c9e7-kube-api-access-lwlxg\") pod \"insights-runtime-extractor-m2j98\" (UID: \"26b20ee4-7d53-453d-b606-80d96ca2c9e7\") " pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:20.969438 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:20.969416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m2j98" Jun 11 16:21:21.014017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.013843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:21.014017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.013896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5wr\" (UniqueName: \"kubernetes.io/projected/af9da2f1-d162-4f6c-b586-e9a4594fbb95-kube-api-access-4w5wr\") pod \"downloads-6657875f97-tc4wt\" (UID: \"af9da2f1-d162-4f6c-b586-e9a4594fbb95\") " pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:21.014017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.013933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:21.014017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.013953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:21.014017 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.013991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrt8\" (UniqueName: \"kubernetes.io/projected/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-kube-api-access-8zrt8\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:21.015398 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.015361 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:21.016944 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.016917 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:21.017434 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.017386 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pxqpf\" (UID: \"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:21.023197 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.023172 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" Jun 11 16:21:21.032659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.032637 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrt8\" (UniqueName: \"kubernetes.io/projected/2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4-kube-api-access-8zrt8\") pod \"managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q\" (UID: \"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:21.040410 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.040392 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" Jun 11 16:21:21.112303 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.112199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" Jun 11 16:21:21.114407 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.114382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5wr\" (UniqueName: \"kubernetes.io/projected/af9da2f1-d162-4f6c-b586-e9a4594fbb95-kube-api-access-4w5wr\") pod \"downloads-6657875f97-tc4wt\" (UID: \"af9da2f1-d162-4f6c-b586-e9a4594fbb95\") " pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:21.118570 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.117170 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m2j98"] Jun 11 16:21:21.124174 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:21.124148 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b20ee4_7d53_453d_b606_80d96ca2c9e7.slice/crio-ec4b4ab4fcbc7e588b72c5e10b623e2f5a20501ef65b6d22d34e8b1ad3741ee2 WatchSource:0}: Error finding container ec4b4ab4fcbc7e588b72c5e10b623e2f5a20501ef65b6d22d34e8b1ad3741ee2: Status 404 returned error can't find the container with id ec4b4ab4fcbc7e588b72c5e10b623e2f5a20501ef65b6d22d34e8b1ad3741ee2 Jun 11 16:21:21.131004 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.130951 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5wr\" (UniqueName: \"kubernetes.io/projected/af9da2f1-d162-4f6c-b586-e9a4594fbb95-kube-api-access-4w5wr\") pod \"downloads-6657875f97-tc4wt\" (UID: \"af9da2f1-d162-4f6c-b586-e9a4594fbb95\") " pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:21.173909 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.173838 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr"] Jun 11 16:21:21.180216 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:21.180182 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b56a4d_37d8_49e2_80be_cc8842e7ecf3.slice/crio-3c057acb8502810eb8a508e64669a77750d6a537bc522b0c58bd011495a101e5 WatchSource:0}: Error finding container 3c057acb8502810eb8a508e64669a77750d6a537bc522b0c58bd011495a101e5: Status 404 returned error can't find the container with id 3c057acb8502810eb8a508e64669a77750d6a537bc522b0c58bd011495a101e5 Jun 11 16:21:21.199660 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.199627 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q"] Jun 11 16:21:21.210439 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:21.210412 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a9a3f10_f282_4fa0_88f5_540cfc9fe3a4.slice/crio-649f14c7eea9174f1eed7789f99833fa939334d2805fc49bff5cedd7fbe5b4e8 WatchSource:0}: Error finding container 649f14c7eea9174f1eed7789f99833fa939334d2805fc49bff5cedd7fbe5b4e8: Status 404 returned error can't find the container with id 649f14c7eea9174f1eed7789f99833fa939334d2805fc49bff5cedd7fbe5b4e8 Jun 11 16:21:21.265729 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.265701 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf"] Jun 11 16:21:21.268524 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:21.268492 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a82a42d_7e03_4fc8_8c2a_90a8f5b1d2be.slice/crio-ce732cba436c99eae996efcaa0fc1ad0d106ebea95ab69d62cb2d83acf225367 WatchSource:0}: Error finding container ce732cba436c99eae996efcaa0fc1ad0d106ebea95ab69d62cb2d83acf225367: Status 404 returned error can't find the container with id ce732cba436c99eae996efcaa0fc1ad0d106ebea95ab69d62cb2d83acf225367 Jun 11 16:21:21.426585 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.426496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:21.561036 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:21.561000 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tc4wt"] Jun 11 16:21:21.564209 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:21.564188 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9da2f1_d162_4f6c_b586_e9a4594fbb95.slice/crio-1ce21b541fd1ce589b3f9778636e5a651a9808b92bf163e12c47e2a12f3696ea WatchSource:0}: Error finding container 1ce21b541fd1ce589b3f9778636e5a651a9808b92bf163e12c47e2a12f3696ea: Status 404 returned error can't find the container with id 1ce21b541fd1ce589b3f9778636e5a651a9808b92bf163e12c47e2a12f3696ea Jun 11 16:21:22.070232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.070070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tc4wt" event={"ID":"af9da2f1-d162-4f6c-b586-e9a4594fbb95","Type":"ContainerStarted","Data":"1ce21b541fd1ce589b3f9778636e5a651a9808b92bf163e12c47e2a12f3696ea"} Jun 11 16:21:22.072051 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.071986 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" event={"ID":"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4","Type":"ContainerStarted","Data":"649f14c7eea9174f1eed7789f99833fa939334d2805fc49bff5cedd7fbe5b4e8"} Jun 11 16:21:22.075358 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.075336 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2j98" event={"ID":"26b20ee4-7d53-453d-b606-80d96ca2c9e7","Type":"ContainerStarted","Data":"2340fb2e370a3a4ffcec2678c27e3bd6cd2c0801aa2d0bd1d874e8e33e5ed7ad"} Jun 11 16:21:22.075446 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.075390 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2j98" event={"ID":"26b20ee4-7d53-453d-b606-80d96ca2c9e7","Type":"ContainerStarted","Data":"a5e0bd07075d0c90c5e42bb268ff292cd6f49a56bc93cb40d16b222897c8eee3"} Jun 11 16:21:22.075513 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.075454 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2j98" event={"ID":"26b20ee4-7d53-453d-b606-80d96ca2c9e7","Type":"ContainerStarted","Data":"ec4b4ab4fcbc7e588b72c5e10b623e2f5a20501ef65b6d22d34e8b1ad3741ee2"} Jun 11 16:21:22.076907 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.076853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" event={"ID":"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be","Type":"ContainerStarted","Data":"ce732cba436c99eae996efcaa0fc1ad0d106ebea95ab69d62cb2d83acf225367"} Jun 11 16:21:22.080200 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.079691 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" event={"ID":"37b56a4d-37d8-49e2-80be-cc8842e7ecf3","Type":"ContainerStarted","Data":"f3c8e75f919cf27821490f3206f1b837e3385564c9b3cb6027c865bc3fc6d2f0"} Jun 11 16:21:22.080200 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.079731 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" event={"ID":"37b56a4d-37d8-49e2-80be-cc8842e7ecf3","Type":"ContainerStarted","Data":"3c057acb8502810eb8a508e64669a77750d6a537bc522b0c58bd011495a101e5"} Jun 11 16:21:22.101284 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:22.101226 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wkhwr" podStartSLOduration=2.10120577 podStartE2EDuration="2.10120577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:22.099127149 +0000 UTC m=+125.986732298" watchObservedRunningTime="2026-06-11 16:21:22.10120577 +0000 UTC m=+125.988810920" Jun 11 16:21:23.086716 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:23.086592 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" event={"ID":"5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be","Type":"ContainerStarted","Data":"65dfe07c86d793f28c3c673a79e4998db2eb2a5fd62a6474d86cbaa4208795b8"} Jun 11 16:21:23.109686 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:23.108414 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pxqpf" podStartSLOduration=1.847494704 podStartE2EDuration="3.108393407s" totalImagesPullingTime="1.260898703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:23.108129626 +0000 UTC m=+126.995734773" watchObservedRunningTime="2026-06-11 16:21:23.108393407 +0000 UTC m=+126.995998551" Jun 11 16:21:25.098321 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:25.098284 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" event={"ID":"2a9a3f10-f282-4fa0-88f5-540cfc9fe3a4","Type":"ContainerStarted","Data":"c65f26439c36188c3ae910198a2b42e72d4279b083048f7383718f2a5bab8a66"} Jun 11 16:21:25.100562 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:25.100535 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2j98" event={"ID":"26b20ee4-7d53-453d-b606-80d96ca2c9e7","Type":"ContainerStarted","Data":"beb81b65e7f27f3636efc88606061a8a713ac4a9676890239e5fa7770da54f74"} Jun 11 16:21:25.114626 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:25.114576 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8bb64b4b6-c8b6q" podStartSLOduration=1.386617369 podStartE2EDuration="5.114557502s" totalImagesPullingTime="3.727940133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:25.113536066 +0000 UTC m=+129.001141224" watchObservedRunningTime="2026-06-11 16:21:25.114557502 +0000 UTC m=+129.002162648" Jun 11 16:21:25.133029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:25.132709 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m2j98" podStartSLOduration=1.459314341 podStartE2EDuration="5.132688441s" totalImagesPullingTime="3.6733741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:25.131663547 +0000 UTC m=+129.019268695" watchObservedRunningTime="2026-06-11 16:21:25.132688441 +0000 UTC m=+129.020293589" Jun 11 16:21:26.358529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:26.358476 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:21:26.360680 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:26.360659 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82a4dcc6-86f8-4a17-b32b-6166ff650641-metrics-certs\") pod \"network-metrics-daemon-hc4dt\" (UID: \"82a4dcc6-86f8-4a17-b32b-6166ff650641\") " pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:21:26.445904 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:26.445873 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmdjj\"" Jun 11 16:21:26.454067 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:26.454038 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hc4dt" Jun 11 16:21:26.588791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:26.588765 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hc4dt"] Jun 11 16:21:26.591276 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:26.591244 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a4dcc6_86f8_4a17_b32b_6166ff650641.slice/crio-470622402e64908cf05d4ee353fbf6a8146bfc2effb6cdb84a4f253f23c3d8d2 WatchSource:0}: Error finding container 470622402e64908cf05d4ee353fbf6a8146bfc2effb6cdb84a4f253f23c3d8d2: Status 404 returned error can't find the container with id 470622402e64908cf05d4ee353fbf6a8146bfc2effb6cdb84a4f253f23c3d8d2 Jun 11 16:21:27.108581 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.108542 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc4dt" event={"ID":"82a4dcc6-86f8-4a17-b32b-6166ff650641","Type":"ContainerStarted","Data":"470622402e64908cf05d4ee353fbf6a8146bfc2effb6cdb84a4f253f23c3d8d2"} Jun 11 16:21:27.288602 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.288560 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5"] Jun 11 16:21:27.292110 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.292081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:27.295531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.295333 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:21:27.295531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.295345 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qv7vb\"" Jun 11 16:21:27.304745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.304723 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5"] Jun 11 16:21:27.368269 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.368187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bb09e1-c058-4f35-aeb9-2ac003d57b9e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vbpd5\" (UID: \"f4bb09e1-c058-4f35-aeb9-2ac003d57b9e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:27.469301 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.469266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bb09e1-c058-4f35-aeb9-2ac003d57b9e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vbpd5\" (UID: \"f4bb09e1-c058-4f35-aeb9-2ac003d57b9e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:27.472633 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.472571 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f4bb09e1-c058-4f35-aeb9-2ac003d57b9e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vbpd5\" (UID: \"f4bb09e1-c058-4f35-aeb9-2ac003d57b9e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:27.604551 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.604516 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:27.765277 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:27.765244 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5"] Jun 11 16:21:27.767913 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:27.767883 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bb09e1_c058_4f35_aeb9_2ac003d57b9e.slice/crio-13d95ac016a53ad7c3c70fb086a9f6491c60d513572c876c4922632f56bff29a WatchSource:0}: Error finding container 13d95ac016a53ad7c3c70fb086a9f6491c60d513572c876c4922632f56bff29a: Status 404 returned error can't find the container with id 13d95ac016a53ad7c3c70fb086a9f6491c60d513572c876c4922632f56bff29a Jun 11 16:21:28.114329 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.114281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc4dt" event={"ID":"82a4dcc6-86f8-4a17-b32b-6166ff650641","Type":"ContainerStarted","Data":"2f3ad7d1e38d8b7422d4268dd00cf0eac80370da99c3e93a13631e3cebe83944"} Jun 11 16:21:28.114486 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.114344 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hc4dt" event={"ID":"82a4dcc6-86f8-4a17-b32b-6166ff650641","Type":"ContainerStarted","Data":"16c16e60659adf8038adcb6cd5195461edd708d0ed2371d422f4f0ef67515074"} Jun 11 16:21:28.115666 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.115638 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" event={"ID":"f4bb09e1-c058-4f35-aeb9-2ac003d57b9e","Type":"ContainerStarted","Data":"13d95ac016a53ad7c3c70fb086a9f6491c60d513572c876c4922632f56bff29a"} Jun 11 16:21:28.133299 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.133248 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hc4dt" podStartSLOduration=131.194138793 podStartE2EDuration="2m12.133229408s" totalImagesPullingTime="939.090615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:28.131420167 +0000 UTC m=+132.019025314" watchObservedRunningTime="2026-06-11 16:21:28.133229408 +0000 UTC m=+132.020834556" Jun 11 16:21:28.789683 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.789651 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:21:28.793159 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.793142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.798597 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.798573 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:21:28.799143 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.799123 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:21:28.799143 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.799135 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:21:28.799295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.799166 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:21:28.799295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.799223 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:21:28.799295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.799275 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gzkk8\"" Jun 11 16:21:28.806148 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.806124 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:21:28.881523 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.881645 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.881645 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881574 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.881754 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.881754 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b5tk\" (UniqueName: \"kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.881870 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.881769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.982942 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.982916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983073 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.982955 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983073 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.982988 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983073 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b5tk\" (UniqueName: \"kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983073 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983256 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983608 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983725 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983666 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.983725 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.983691 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.985311 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.985291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.985717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.985698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:28.991944 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:28.991924 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b5tk\" (UniqueName: \"kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk\") pod \"console-7fc7f4c67-8dh5j\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:29.106172 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.106091 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:29.121931 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.121887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" event={"ID":"f4bb09e1-c058-4f35-aeb9-2ac003d57b9e","Type":"ContainerStarted","Data":"12628b6c0ec87905f58459475aadcec9f716b40e09cc3d4ef82718f151a8142f"} Jun 11 16:21:29.122456 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.122439 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:29.128859 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.128834 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" Jun 11 16:21:29.140708 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.140653 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vbpd5" podStartSLOduration=1.060852467 podStartE2EDuration="2.1406312s" totalImagesPullingTime="1.079778733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:29.140108403 +0000 UTC m=+133.027713560" watchObservedRunningTime="2026-06-11 16:21:29.1406312 +0000 UTC m=+133.028236347" Jun 11 16:21:29.259865 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.259783 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:21:29.262771 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:29.262746 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcbd91b_37c2_45b3_8703_0a8ce24c4f31.slice/crio-b5d18cbcf27850b657fe60a063ad8be5d7b6c6c8d66828c71b61e62bcafa8688 WatchSource:0}: Error finding container b5d18cbcf27850b657fe60a063ad8be5d7b6c6c8d66828c71b61e62bcafa8688: Status 404 returned error can't find the container with id b5d18cbcf27850b657fe60a063ad8be5d7b6c6c8d66828c71b61e62bcafa8688 Jun 11 16:21:29.364612 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.364508 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr"] Jun 11 16:21:29.369571 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.369551 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.371999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.371974 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:21:29.372132 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.372079 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:21:29.372132 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.372090 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:21:29.372250 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.372201 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 16:21:29.372365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.372349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8ksnb\"" Jun 11 16:21:29.372442 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.372398 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 16:21:29.378169 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.378109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr"] Jun 11 16:21:29.385814 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.385776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.385927 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.385904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.385989 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.385939 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.385989 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.385965 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w97sq\" (UniqueName: \"kubernetes.io/projected/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-kube-api-access-w97sq\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.486857 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.486791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.487019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.486898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.487019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.486928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.487019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.486949 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w97sq\" (UniqueName: \"kubernetes.io/projected/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-kube-api-access-w97sq\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.487217 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:29.487187 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 16:21:29.487299 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:29.487268 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls podName:8ca9e3a4-9c9a-4472-a92e-6bcc88b82685 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:29.987246608 +0000 UTC m=+133.874851739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-gwgsr" (UID: "8ca9e3a4-9c9a-4472-a92e-6bcc88b82685") : secret "prometheus-operator-tls" not found Jun 11 16:21:29.487639 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.487619 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.489588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.489556 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.496352 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.496323 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w97sq\" (UniqueName: \"kubernetes.io/projected/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-kube-api-access-w97sq\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.992018 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:29.991937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:29.992483 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:29.992111 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 16:21:29.992483 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:29.992194 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls podName:8ca9e3a4-9c9a-4472-a92e-6bcc88b82685 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:30.992175478 +0000 UTC m=+134.879780606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-gwgsr" (UID: "8ca9e3a4-9c9a-4472-a92e-6bcc88b82685") : secret "prometheus-operator-tls" not found Jun 11 16:21:30.128307 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:30.128270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc7f4c67-8dh5j" event={"ID":"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31","Type":"ContainerStarted","Data":"b5d18cbcf27850b657fe60a063ad8be5d7b6c6c8d66828c71b61e62bcafa8688"} Jun 11 16:21:31.002383 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:31.002353 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:31.005086 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:31.005054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca9e3a4-9c9a-4472-a92e-6bcc88b82685-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gwgsr\" (UID: \"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:31.181928 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:31.181791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" Jun 11 16:21:32.266061 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:32.266029 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr"] Jun 11 16:21:32.268880 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:32.268712 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca9e3a4_9c9a_4472_a92e_6bcc88b82685.slice/crio-d3ae598dd002e7eafa4a54705e0ba8d0eb1b86112e666348d3ae214731c168b1 WatchSource:0}: Error finding container d3ae598dd002e7eafa4a54705e0ba8d0eb1b86112e666348d3ae214731c168b1: Status 404 returned error can't find the container with id d3ae598dd002e7eafa4a54705e0ba8d0eb1b86112e666348d3ae214731c168b1 Jun 11 16:21:33.144659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:33.144616 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" event={"ID":"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685","Type":"ContainerStarted","Data":"d3ae598dd002e7eafa4a54705e0ba8d0eb1b86112e666348d3ae214731c168b1"} Jun 11 16:21:33.146707 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:33.146665 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc7f4c67-8dh5j" event={"ID":"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31","Type":"ContainerStarted","Data":"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556"} Jun 11 16:21:39.107084 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:39.107045 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:39.107607 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:39.107118 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:39.112549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:39.112523 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:39.140026 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:39.139943 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fc7f4c67-8dh5j" podStartSLOduration=8.251532701 podStartE2EDuration="11.139920686s" totalImagesPullingTime="2.888387985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:33.165017717 +0000 UTC m=+137.052622863" watchObservedRunningTime="2026-06-11 16:21:39.139920686 +0000 UTC m=+143.027525823" Jun 11 16:21:39.176306 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:39.176272 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:21:41.181391 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.181350 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" event={"ID":"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685","Type":"ContainerStarted","Data":"33d9835bb14f8f41487547c1bf68af89ead956b687a4d5530da5205ff2fe5088"} Jun 11 16:21:41.181917 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.181460 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" event={"ID":"8ca9e3a4-9c9a-4472-a92e-6bcc88b82685","Type":"ContainerStarted","Data":"85ba885828611077df85e7bb5fe866052b19ae9fcadff7112f503b0b0f364a8d"} Jun 11 16:21:41.183083 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.183058 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tc4wt" event={"ID":"af9da2f1-d162-4f6c-b586-e9a4594fbb95","Type":"ContainerStarted","Data":"174952e49de617022294d31dcefff793d062bfaef579fdb9851bb13a1054fa4e"} Jun 11 16:21:41.183294 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.183273 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:41.198813 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.198775 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-tc4wt" Jun 11 16:21:41.212789 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.212734 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gwgsr" podStartSLOduration=4.096721363 podStartE2EDuration="12.212715036s" totalImagesPullingTime="8.115993673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:41.21203462 +0000 UTC m=+145.099639778" watchObservedRunningTime="2026-06-11 16:21:41.212715036 +0000 UTC m=+145.100320185" Jun 11 16:21:41.251309 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:41.251256 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-tc4wt" podStartSLOduration=2.381417159 podStartE2EDuration="21.251242282s" totalImagesPullingTime="18.869825123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:41.249841602 +0000 UTC m=+145.137446752" watchObservedRunningTime="2026-06-11 16:21:41.251242282 +0000 UTC m=+145.138847428" Jun 11 16:21:42.955892 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:42.955853 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-674f7c46f9-79mm5"] Jun 11 16:21:42.956346 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:42.956128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" podUID="74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" Jun 11 16:21:43.005042 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.005003 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5b9c9"] Jun 11 16:21:43.034889 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.034855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.038394 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.038370 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62q4t\"" Jun 11 16:21:43.039061 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.039041 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:21:43.039287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.039104 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:21:43.039607 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.039111 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:21:43.113644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7vf\" (UniqueName: \"kubernetes.io/projected/9af92041-00b2-4e8a-89dc-54e07fe6c513-kube-api-access-xn7vf\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.113859 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-accelerators-collector-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.113859 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-root\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.113859 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-wtmp\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.113859 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.114019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-metrics-client-ca\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.114019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-tls\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.114019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.113999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-textfile\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.114121 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.114020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-sys\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.191045 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.191008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:21:43.215365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215287 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-root\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-wtmp\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215553 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-metrics-client-ca\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215553 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215441 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-root\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215553 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-tls\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215553 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-textfile\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215553 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-sys\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215711 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7vf\" (UniqueName: \"kubernetes.io/projected/9af92041-00b2-4e8a-89dc-54e07fe6c513-kube-api-access-xn7vf\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.215711 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.215617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-accelerators-collector-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.218061 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.218442 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-textfile\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.218760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-accelerators-collector-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.219116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-tls\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.219242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-wtmp\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.219461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af92041-00b2-4e8a-89dc-54e07fe6c513-metrics-client-ca\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.219945 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.216245 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9af92041-00b2-4e8a-89dc-54e07fe6c513-sys\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.227835 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.220641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9af92041-00b2-4e8a-89dc-54e07fe6c513-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.241764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.241738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7vf\" (UniqueName: \"kubernetes.io/projected/9af92041-00b2-4e8a-89dc-54e07fe6c513-kube-api-access-xn7vf\") pod \"node-exporter-5b9c9\" (UID: \"9af92041-00b2-4e8a-89dc-54e07fe6c513\") " pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.316865 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.316829 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.316865 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.316876 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317122 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.316939 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317122 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317044 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317122 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317120 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317280 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317171 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317280 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317212 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwh5h\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h\") pod \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\" (UID: \"74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4\") " Jun 11 16:21:43.317280 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317239 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:21:43.317603 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317578 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:21:43.317745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317718 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:21:43.317848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317829 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-ca-trust-extracted\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.317921 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317854 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-certificates\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.317921 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.317869 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-trusted-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.319716 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.319691 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:21:43.319975 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.319952 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:21:43.320112 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.320082 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h" (OuterVolumeSpecName: "kube-api-access-xwh5h") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "kube-api-access-xwh5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:21:43.320267 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.320243 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" (UID: "74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:21:43.346422 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.346387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5b9c9" Jun 11 16:21:43.384363 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:43.384311 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af92041_00b2_4e8a_89dc_54e07fe6c513.slice/crio-0cfda97b2412f4f8c02cc25a90bff195a8f9c8d4a864800018cd04e53a9a6088 WatchSource:0}: Error finding container 0cfda97b2412f4f8c02cc25a90bff195a8f9c8d4a864800018cd04e53a9a6088: Status 404 returned error can't find the container with id 0cfda97b2412f4f8c02cc25a90bff195a8f9c8d4a864800018cd04e53a9a6088 Jun 11 16:21:43.418984 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.418943 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwh5h\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-kube-api-access-xwh5h\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.418984 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.418973 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-installation-pull-secrets\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.418984 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.418989 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-image-registry-private-configuration\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.419257 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.419001 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-bound-sa-token\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:43.959871 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.959836 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:21:43.978373 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.978338 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:43.982364 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.981763 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 16:21:43.982364 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.981766 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 16:21:43.982364 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.982293 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 16:21:43.983035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983010 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 16:21:43.983171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983056 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 16:21:43.983349 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983243 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 16:21:43.983349 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983309 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 16:21:43.983494 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983423 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 16:21:43.983579 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983526 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mzknt\"" Jun 11 16:21:43.983666 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.983642 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 16:21:43.985002 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:43.984971 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:21:44.024317 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024505 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024505 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024505 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024505 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024454 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kjd\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024759 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.024908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.025031 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.024946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.025031 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.025007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126294 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126779 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126493 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126779 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kjd\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.126779 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:44.126670 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle podName:93c571b0-4f13-4848-ab92-37f55328b4c7 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:44.626646981 +0000 UTC m=+148.514252128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7") : configmap references non-existent config key: ca-bundle.crt Jun 11 16:21:44.126779 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126731 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.127029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126788 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.127029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.127029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.126877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.128100 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.128073 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.129680 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.129558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.130560 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.130533 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.131498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.131242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.131498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.131309 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.131498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.131391 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.131709 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.131632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.131709 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.131688 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.132171 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.132149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.132268 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.132237 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.132903 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.132884 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.139268 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.139248 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kjd\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.198067 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.198020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5b9c9" event={"ID":"9af92041-00b2-4e8a-89dc-54e07fe6c513","Type":"ContainerStarted","Data":"0cfda97b2412f4f8c02cc25a90bff195a8f9c8d4a864800018cd04e53a9a6088"} Jun 11 16:21:44.198249 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.198039 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-674f7c46f9-79mm5" Jun 11 16:21:44.243826 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.243726 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-674f7c46f9-79mm5"] Jun 11 16:21:44.250589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.250560 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-674f7c46f9-79mm5"] Jun 11 16:21:44.329301 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.329267 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4-registry-tls\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:21:44.538053 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.537976 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4" path="/var/lib/kubelet/pods/74b140c5-0e9d-43e8-9c3f-7578c3a0ecb4/volumes" Jun 11 16:21:44.631811 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.631712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.632546 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.632523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.892261 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.892220 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:21:44.978948 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:44.978636 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:21:45.343829 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:45.343783 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:21:45.347325 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:45.347295 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c571b0_4f13_4848_ab92_37f55328b4c7.slice/crio-0d167cfa3e2f3bf04aed1b774458b0aa0ac6c8602072dbddca194f46d9aa6c4b WatchSource:0}: Error finding container 0d167cfa3e2f3bf04aed1b774458b0aa0ac6c8602072dbddca194f46d9aa6c4b: Status 404 returned error can't find the container with id 0d167cfa3e2f3bf04aed1b774458b0aa0ac6c8602072dbddca194f46d9aa6c4b Jun 11 16:21:45.976032 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:45.973948 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-654467b86-jnktm"] Jun 11 16:21:46.015083 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.014949 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-654467b86-jnktm"] Jun 11 16:21:46.015083 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.015070 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.018195 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.017997 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 16:21:46.033297 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.032983 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 16:21:46.033297 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.033065 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 16:21:46.033297 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.033169 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 16:21:46.033297 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.032983 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 16:21:46.033668 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.033422 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cf9e61aubpvg3\"" Jun 11 16:21:46.034621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.034602 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x7j4v\"" Jun 11 16:21:46.145317 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-grpc-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5345b03f-b87b-429d-84db-4917e2269ac2-metrics-client-ca\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145723 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn2kk\" (UniqueName: \"kubernetes.io/projected/5345b03f-b87b-429d-84db-4917e2269ac2-kube-api-access-gn2kk\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.145723 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.145539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.218238 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.218198 2557 generic.go:356] "Generic (PLEG): container finished" podID="9af92041-00b2-4e8a-89dc-54e07fe6c513" containerID="ddaa513991c5791ac71320f0c849ee345fedb0ac9249f5712e43f6abb128fba0" exitCode=0 Jun 11 16:21:46.218415 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.218294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5b9c9" event={"ID":"9af92041-00b2-4e8a-89dc-54e07fe6c513","Type":"ContainerDied","Data":"ddaa513991c5791ac71320f0c849ee345fedb0ac9249f5712e43f6abb128fba0"} Jun 11 16:21:46.219856 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.219831 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"0d167cfa3e2f3bf04aed1b774458b0aa0ac6c8602072dbddca194f46d9aa6c4b"} Jun 11 16:21:46.246987 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.246877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.246987 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.246965 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-grpc-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247108 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5345b03f-b87b-429d-84db-4917e2269ac2-metrics-client-ca\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.247186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn2kk\" (UniqueName: \"kubernetes.io/projected/5345b03f-b87b-429d-84db-4917e2269ac2-kube-api-access-gn2kk\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.248066 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5345b03f-b87b-429d-84db-4917e2269ac2-metrics-client-ca\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.250144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.250897 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.252922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.252961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-grpc-tls\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.253477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.257724 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.254938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5345b03f-b87b-429d-84db-4917e2269ac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.258330 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.257744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn2kk\" (UniqueName: \"kubernetes.io/projected/5345b03f-b87b-429d-84db-4917e2269ac2-kube-api-access-gn2kk\") pod \"thanos-querier-654467b86-jnktm\" (UID: \"5345b03f-b87b-429d-84db-4917e2269ac2\") " pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.327642 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.327584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:46.736607 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:46.736038 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-654467b86-jnktm"] Jun 11 16:21:46.738979 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:46.738952 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5345b03f_b87b_429d_84db_4917e2269ac2.slice/crio-0274c904c05f82ec4f2654a25f6f799d412804c4a3406500f5af081b399830ff WatchSource:0}: Error finding container 0274c904c05f82ec4f2654a25f6f799d412804c4a3406500f5af081b399830ff: Status 404 returned error can't find the container with id 0274c904c05f82ec4f2654a25f6f799d412804c4a3406500f5af081b399830ff Jun 11 16:21:47.227519 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.227364 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891" exitCode=0 Jun 11 16:21:47.228003 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.227412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891"} Jun 11 16:21:47.231395 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.231368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5b9c9" event={"ID":"9af92041-00b2-4e8a-89dc-54e07fe6c513","Type":"ContainerStarted","Data":"21c5d68f3a4fc73c2f35127e10a99a9d47a81c0814bd6bf0583a7a044beb31af"} Jun 11 16:21:47.231504 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.231425 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5b9c9" event={"ID":"9af92041-00b2-4e8a-89dc-54e07fe6c513","Type":"ContainerStarted","Data":"03ffae84a2b13373a8a18a82a58958eaad30a96745c2967d086a07e40e4758dc"} Jun 11 16:21:47.233526 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.233477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"0274c904c05f82ec4f2654a25f6f799d412804c4a3406500f5af081b399830ff"} Jun 11 16:21:47.304648 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.304590 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5b9c9" podStartSLOduration=3.01493111 podStartE2EDuration="5.304565436s" totalImagesPullingTime="2.182105426s" totalInitContainerRuntime="107.5289ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:47.304096704 +0000 UTC m=+151.191701853" watchObservedRunningTime="2026-06-11 16:21:47.304565436 +0000 UTC m=+151.192170607" Jun 11 16:21:47.602090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.600192 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:21:47.634335 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.634258 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp"] Jun 11 16:21:47.636397 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.636182 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.650481 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.650442 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:21:47.661764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.661735 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:21:47.662060 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.662037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.663036 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.663012 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp"] Jun 11 16:21:47.667373 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.667353 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tsvzg\"" Jun 11 16:21:47.667814 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.667787 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 16:21:47.761755 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.762005 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762005 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762005 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761900 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762005 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-kube-api-access-fzsp4\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.762005 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.761998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762304 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.762037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762304 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.762059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxnn\" (UniqueName: \"kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.762304 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.762190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.863486 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.863486 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863429 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.863486 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-kube-api-access-fzsp4\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863646 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864281 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.863668 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxnn\" (UniqueName: \"kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864570 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.864386 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.864570 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.864434 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.865219 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.865195 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.865928 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.865902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.868576 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.868548 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.870549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.870524 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.872013 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.871962 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.877284 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.877240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c-kube-api-access-fzsp4\") pod \"monitoring-plugin-76b68cc874-vwfbp\" (UID: \"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:47.879912 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.879869 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxnn\" (UniqueName: \"kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn\") pod \"console-58bf6f595f-wccpn\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.957211 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.957157 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:47.975183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:47.975150 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:48.201225 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:48.200922 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:21:48.211944 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:48.211710 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616c9966_8a2f_402e_afe7_fbaf3e23fdf6.slice/crio-8d27ed7c02afc90fb32d926c6100f3d7f7ef9cdef676c6e5879ecb60c0a504d9 WatchSource:0}: Error finding container 8d27ed7c02afc90fb32d926c6100f3d7f7ef9cdef676c6e5879ecb60c0a504d9: Status 404 returned error can't find the container with id 8d27ed7c02afc90fb32d926c6100f3d7f7ef9cdef676c6e5879ecb60c0a504d9 Jun 11 16:21:48.242289 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:48.241979 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf6f595f-wccpn" event={"ID":"616c9966-8a2f-402e-afe7-fbaf3e23fdf6","Type":"ContainerStarted","Data":"8d27ed7c02afc90fb32d926c6100f3d7f7ef9cdef676c6e5879ecb60c0a504d9"} Jun 11 16:21:48.249971 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:48.249925 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp"] Jun 11 16:21:48.254874 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:48.254846 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6258a7d_eeb3_4b4d_900e_4a7fbd1b682c.slice/crio-3b31b211cb8d8f6e7388d812180461ecadc075635c3099311027b94a56b41c7b WatchSource:0}: Error finding container 3b31b211cb8d8f6e7388d812180461ecadc075635c3099311027b94a56b41c7b: Status 404 returned error can't find the container with id 3b31b211cb8d8f6e7388d812180461ecadc075635c3099311027b94a56b41c7b Jun 11 16:21:49.250029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.249158 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf6f595f-wccpn" event={"ID":"616c9966-8a2f-402e-afe7-fbaf3e23fdf6","Type":"ContainerStarted","Data":"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9"} Jun 11 16:21:49.252106 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.252046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" event={"ID":"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c","Type":"ContainerStarted","Data":"3b31b211cb8d8f6e7388d812180461ecadc075635c3099311027b94a56b41c7b"} Jun 11 16:21:49.264904 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.264870 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:21:49.282256 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.282181 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58bf6f595f-wccpn" podStartSLOduration=2.282159944 podStartE2EDuration="2.282159944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:49.280717868 +0000 UTC m=+153.168323015" watchObservedRunningTime="2026-06-11 16:21:49.282159944 +0000 UTC m=+153.169765091" Jun 11 16:21:49.283875 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.283852 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.286576 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.286399 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 16:21:49.289501 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 16:21:49.289501 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289127 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 16:21:49.289670 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289483 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 16:21:49.289670 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289628 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 16:21:49.290035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289772 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lb2jt\"" Jun 11 16:21:49.290035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.289850 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.290244 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.290337 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.290443 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.290841 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.290899 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.291044 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.291162 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f0stce5i59g3m\"" Jun 11 16:21:49.291529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.291276 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 16:21:49.293146 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.292818 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 16:21:49.309439 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.309177 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 16:21:49.311508 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.311476 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:21:49.379833 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.379833 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.379981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380341 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380459 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.380507 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.380485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9ch\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.481994 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.481939 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482182 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482344 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.482653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.482514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485379 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9ch\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485693 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.485699 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.486423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.486829 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.487353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.487860 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.487569 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.488745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.487954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.488745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.488073 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.488745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.488176 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.488745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.488542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.488745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.488726 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.489035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.488832 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.489497 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.489445 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.490063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.490008 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.490579 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.490556 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.491622 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.491599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.491760 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.491618 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.492126 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.492105 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.492214 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.492175 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.493486 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.493461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.497565 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.497526 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9ch\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch\") pod \"prometheus-k8s-0\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:49.603592 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:49.603493 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:50.152042 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.152011 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:21:50.259905 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.259862 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"fac2c7a9b3e94bd60cbcf5c9a20492bb95f4e91f8bfad433930b3c869bf26485"} Jun 11 16:21:50.260355 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.259946 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"8660618f8583704c5bb942c16f479afd8b76975ba00826243f72472683c4dcea"} Jun 11 16:21:50.264534 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.264390 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54"} Jun 11 16:21:50.264534 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.264468 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28"} Jun 11 16:21:50.266713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:50.266418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"c62446cda508033a5753179663c9b0e0dadc131ce3b3bfe23df5282eb55756d3"} Jun 11 16:21:51.277409 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.277372 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"1096d684207df86a7e1ad8b7e5bf8d28821f7e5b03abbc101502785501055edc"} Jun 11 16:21:51.280552 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.280525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b"} Jun 11 16:21:51.280694 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.280597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a"} Jun 11 16:21:51.280694 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.280651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a"} Jun 11 16:21:51.282096 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.282069 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" exitCode=0 Jun 11 16:21:51.282213 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.282152 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} Jun 11 16:21:51.283897 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.283873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" event={"ID":"d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c","Type":"ContainerStarted","Data":"d71df658a9a518535e456e9e73324974bfea2434ad112f2de6102e3a089f9c90"} Jun 11 16:21:51.284142 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.284125 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:51.290330 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.290306 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" Jun 11 16:21:51.333780 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:51.333737 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vwfbp" podStartSLOduration=1.483181217 podStartE2EDuration="4.33372266s" totalImagesPullingTime="2.850541443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:51.33166548 +0000 UTC m=+155.219270627" watchObservedRunningTime="2026-06-11 16:21:51.33372266 +0000 UTC m=+155.221327805" Jun 11 16:21:52.290872 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.290833 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"7bfb9e32bb9a8e1adcc5236f4d815a7d006cb42752a2c99cc3b02c6437275f7f"} Jun 11 16:21:52.291270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.290919 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"61b081d41b965c33ed659660a8a8803801c8ffa803259c30a96cde5ca2d531ec"} Jun 11 16:21:52.291270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.290966 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" event={"ID":"5345b03f-b87b-429d-84db-4917e2269ac2","Type":"ContainerStarted","Data":"ccbaf4b686f82c22ded70a2bc3ebab1018a4176ac502f3f023d2ca9493ec7105"} Jun 11 16:21:52.291270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.291014 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:52.294048 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.294020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerStarted","Data":"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee"} Jun 11 16:21:52.341521 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.341413 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" podStartSLOduration=2.591863612 podStartE2EDuration="7.341391223s" totalImagesPullingTime="4.749527611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:52.339736535 +0000 UTC m=+156.227341683" watchObservedRunningTime="2026-06-11 16:21:52.341391223 +0000 UTC m=+156.228996370" Jun 11 16:21:52.398201 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:52.398150 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.031675289 podStartE2EDuration="9.398129382s" totalImagesPullingTime="5.347459351s" totalInitContainerRuntime="18.994742ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:52.396979071 +0000 UTC m=+156.284584220" watchObservedRunningTime="2026-06-11 16:21:52.398129382 +0000 UTC m=+156.285734530" Jun 11 16:21:54.568993 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:21:54.568942 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s9rpw" podUID="aad08e4e-4cfe-4420-a071-6210f76d154c" Jun 11 16:21:55.308901 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:55.308865 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9rpw" Jun 11 16:21:56.316262 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:56.316235 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} Jun 11 16:21:56.316561 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:56.316306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} Jun 11 16:21:56.316561 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:56.316335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} Jun 11 16:21:56.316561 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:56.316366 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} Jun 11 16:21:57.323718 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.323680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} Jun 11 16:21:57.324118 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.323781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerStarted","Data":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} Jun 11 16:21:57.377461 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.377402 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.9317257960000003 podStartE2EDuration="8.377384856s" totalImagesPullingTime="4.402520775s" totalInitContainerRuntime="43.138285ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:57.375941103 +0000 UTC m=+161.263546248" watchObservedRunningTime="2026-06-11 16:21:57.377384856 +0000 UTC m=+161.264990002" Jun 11 16:21:57.958337 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.958300 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:57.958522 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.958371 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:57.963284 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:57.963263 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:58.304784 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:58.304711 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-654467b86-jnktm" Jun 11 16:21:58.332564 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:58.332533 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:21:59.489641 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.489604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:21:59.491973 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.491951 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aad08e4e-4cfe-4420-a071-6210f76d154c-metrics-tls\") pod \"dns-default-s9rpw\" (UID: \"aad08e4e-4cfe-4420-a071-6210f76d154c\") " pod="openshift-dns/dns-default-s9rpw" Jun 11 16:21:59.512717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.512686 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmgzf\"" Jun 11 16:21:59.520353 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.520326 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9rpw" Jun 11 16:21:59.604397 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.604364 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:21:59.685360 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:21:59.685307 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9rpw"] Jun 11 16:21:59.687629 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:21:59.687604 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad08e4e_4cfe_4420_a071_6210f76d154c.slice/crio-f6ec41ae9506b945398b10aedf6e0fef6e5ce2e4c95848f5f7192eedeeecb6eb WatchSource:0}: Error finding container f6ec41ae9506b945398b10aedf6e0fef6e5ce2e4c95848f5f7192eedeeecb6eb: Status 404 returned error can't find the container with id f6ec41ae9506b945398b10aedf6e0fef6e5ce2e4c95848f5f7192eedeeecb6eb Jun 11 16:22:00.341692 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:00.341646 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9rpw" event={"ID":"aad08e4e-4cfe-4420-a071-6210f76d154c","Type":"ContainerStarted","Data":"f6ec41ae9506b945398b10aedf6e0fef6e5ce2e4c95848f5f7192eedeeecb6eb"} Jun 11 16:22:02.351228 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:02.351193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9rpw" event={"ID":"aad08e4e-4cfe-4420-a071-6210f76d154c","Type":"ContainerStarted","Data":"479767776c50aa01512f8107f4030405e3f59da170fa5d0580fe65e9fa70ba00"} Jun 11 16:22:02.351664 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:02.351243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9rpw" event={"ID":"aad08e4e-4cfe-4420-a071-6210f76d154c","Type":"ContainerStarted","Data":"ced1dac7d49ff07dd9efdba2039a218b759c67247966c4c2e71cba52475f3296"} Jun 11 16:22:02.351664 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:02.351335 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s9rpw" Jun 11 16:22:02.373962 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:02.373903 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s9rpw" podStartSLOduration=129.456235179 podStartE2EDuration="2m11.373874398s" totalImagesPullingTime="1.917639219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:02.373020214 +0000 UTC m=+166.260625360" watchObservedRunningTime="2026-06-11 16:22:02.373874398 +0000 UTC m=+166.261479544" Jun 11 16:22:10.005965 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.005841 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fc7f4c67-8dh5j" podUID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" containerName="console" containerID="cri-o://1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556" gracePeriod=15 Jun 11 16:22:10.259204 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.259149 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:22:10.278433 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278403 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.278538 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278443 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.278538 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278486 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.278621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278582 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b5tk\" (UniqueName: \"kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.278621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278615 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.278714 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.278641 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config\") pod \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\" (UID: \"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31\") " Jun 11 16:22:10.279062 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.279031 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:10.279167 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.279031 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:10.279167 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.279128 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config" (OuterVolumeSpecName: "console-config") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:22:10.281474 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.281405 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:10.282863 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.282823 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk" (OuterVolumeSpecName: "kube-api-access-2b5tk") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "kube-api-access-2b5tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:10.283051 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.283028 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" (UID: "1bcbd91b-37c2-45b3-8703-0a8ce24c4f31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:22:10.379346 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379309 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b5tk\" (UniqueName: \"kubernetes.io/projected/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-kube-api-access-2b5tk\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.379346 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379338 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-oauth-serving-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.379346 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379347 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.379346 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379356 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-serving-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.379616 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379365 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-console-oauth-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.379616 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.379376 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31-service-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:22:10.384856 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.384823 2557 generic.go:356] "Generic (PLEG): container finished" podID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" containerID="1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556" exitCode=0 Jun 11 16:22:10.384977 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.384867 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc7f4c67-8dh5j" Jun 11 16:22:10.384977 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.384889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc7f4c67-8dh5j" event={"ID":"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31","Type":"ContainerDied","Data":"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556"} Jun 11 16:22:10.384977 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.384942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc7f4c67-8dh5j" event={"ID":"1bcbd91b-37c2-45b3-8703-0a8ce24c4f31","Type":"ContainerDied","Data":"b5d18cbcf27850b657fe60a063ad8be5d7b6c6c8d66828c71b61e62bcafa8688"} Jun 11 16:22:10.384977 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.384962 2557 scope.go:117] "RemoveContainer" containerID="1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556" Jun 11 16:22:10.393638 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.393621 2557 scope.go:117] "RemoveContainer" containerID="1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556" Jun 11 16:22:10.393917 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:22:10.393898 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556\": container with ID starting with 1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556 not found: ID does not exist" containerID="1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556" Jun 11 16:22:10.393984 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.393924 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556"} err="failed to get container status \"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556\": rpc error: code = NotFound desc = could not find container \"1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556\": container with ID starting with 1370ddc2f896f0dfc10e3fa24d585355e9c75472e485b17d28395c9f752ed556 not found: ID does not exist" Jun 11 16:22:10.409120 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.409093 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:22:10.410963 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.410943 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fc7f4c67-8dh5j"] Jun 11 16:22:10.538373 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:10.538297 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" path="/var/lib/kubelet/pods/1bcbd91b-37c2-45b3-8703-0a8ce24c4f31/volumes" Jun 11 16:22:12.358341 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:12.358310 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s9rpw" Jun 11 16:22:25.451207 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:25.451171 2557 generic.go:356] "Generic (PLEG): container finished" podID="df462b57-feae-48cc-958d-292f5d24466c" containerID="38c8573e267d374d8579bf8133f8a33fd7f245df3445a152a9202b987ff1fa08" exitCode=0 Jun 11 16:22:25.451597 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:25.451248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" event={"ID":"df462b57-feae-48cc-958d-292f5d24466c","Type":"ContainerDied","Data":"38c8573e267d374d8579bf8133f8a33fd7f245df3445a152a9202b987ff1fa08"} Jun 11 16:22:25.451597 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:25.451556 2557 scope.go:117] "RemoveContainer" containerID="38c8573e267d374d8579bf8133f8a33fd7f245df3445a152a9202b987ff1fa08" Jun 11 16:22:26.457492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:26.457457 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrfgw" event={"ID":"df462b57-feae-48cc-958d-292f5d24466c","Type":"ContainerStarted","Data":"6cc61e0a37e374cd1e18295134217db774a45a60b367729563b8265a785814d6"} Jun 11 16:22:49.603982 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:49.603947 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:22:49.623020 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:49.622993 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:22:50.575046 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:22:50.575020 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:03.306043 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306010 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:03.306512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306326 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="alertmanager" containerID="cri-o://23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" gracePeriod=120 Jun 11 16:23:03.306512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306446 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-web" containerID="cri-o://3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" gracePeriod=120 Jun 11 16:23:03.306512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306476 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="config-reloader" containerID="cri-o://2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" gracePeriod=120 Jun 11 16:23:03.306686 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306518 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-metric" containerID="cri-o://bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" gracePeriod=120 Jun 11 16:23:03.306686 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306429 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="prom-label-proxy" containerID="cri-o://741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" gracePeriod=120 Jun 11 16:23:03.306686 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.306543 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy" containerID="cri-o://0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" gracePeriod=120 Jun 11 16:23:03.613791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613704 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" exitCode=0 Jun 11 16:23:03.613791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613729 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" exitCode=0 Jun 11 16:23:03.613791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613736 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" exitCode=0 Jun 11 16:23:03.613791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613741 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" exitCode=0 Jun 11 16:23:03.613791 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613779 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee"} Jun 11 16:23:03.614109 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613872 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a"} Jun 11 16:23:03.614109 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613912 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54"} Jun 11 16:23:03.614109 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:03.613950 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28"} Jun 11 16:23:04.549248 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.549224 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:04.622754 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622669 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" exitCode=0 Jun 11 16:23:04.622754 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622697 2557 generic.go:356] "Generic (PLEG): container finished" podID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerID="3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" exitCode=0 Jun 11 16:23:04.622754 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622693 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b"} Jun 11 16:23:04.623037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622753 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:04.623037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622776 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a"} Jun 11 16:23:04.623037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622832 2557 scope.go:117] "RemoveContainer" containerID="741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" Jun 11 16:23:04.623037 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.622837 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93c571b0-4f13-4848-ab92-37f55328b4c7","Type":"ContainerDied","Data":"0d167cfa3e2f3bf04aed1b774458b0aa0ac6c8602072dbddca194f46d9aa6c4b"} Jun 11 16:23:04.631127 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.631107 2557 scope.go:117] "RemoveContainer" containerID="bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" Jun 11 16:23:04.637750 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.637735 2557 scope.go:117] "RemoveContainer" containerID="0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" Jun 11 16:23:04.644366 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.644342 2557 scope.go:117] "RemoveContainer" containerID="3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" Jun 11 16:23:04.650592 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.650575 2557 scope.go:117] "RemoveContainer" containerID="2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" Jun 11 16:23:04.657425 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.657409 2557 scope.go:117] "RemoveContainer" containerID="23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" Jun 11 16:23:04.664013 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.663999 2557 scope.go:117] "RemoveContainer" containerID="c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891" Jun 11 16:23:04.664844 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664737 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.664844 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664764 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.664844 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664783 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.664844 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664823 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664935 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.664969 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665010 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9kjd\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665044 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665075 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665126 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665155 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665183 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665173 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:23:04.665449 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665223 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.665888 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.665861 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:04.666288 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.666254 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:04.666425 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.666378 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls\") pod \"93c571b0-4f13-4848-ab92-37f55328b4c7\" (UID: \"93c571b0-4f13-4848-ab92-37f55328b4c7\") " Jun 11 16:23:04.666999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.666684 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-main-db\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.666999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.666707 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-metrics-client-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.666999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.666722 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c571b0-4f13-4848-ab92-37f55328b4c7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.667759 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.667731 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.667873 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.667844 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.668002 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.667976 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume" (OuterVolumeSpecName: "config-volume") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.668113 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.668091 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:04.668637 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.668610 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out" (OuterVolumeSpecName: "config-out") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:23:04.669539 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.669511 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.669539 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.669511 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd" (OuterVolumeSpecName: "kube-api-access-d9kjd") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "kube-api-access-d9kjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:04.669665 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.669599 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.673084 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.673052 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.680577 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.680558 2557 scope.go:117] "RemoveContainer" containerID="741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" Jun 11 16:23:04.680841 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.680818 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee\": container with ID starting with 741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee not found: ID does not exist" containerID="741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" Jun 11 16:23:04.680924 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.680847 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee"} err="failed to get container status \"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee\": rpc error: code = NotFound desc = could not find container \"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee\": container with ID starting with 741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee not found: ID does not exist" Jun 11 16:23:04.680924 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.680867 2557 scope.go:117] "RemoveContainer" containerID="bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" Jun 11 16:23:04.681088 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.681071 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b\": container with ID starting with bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b not found: ID does not exist" containerID="bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" Jun 11 16:23:04.681153 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681089 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b"} err="failed to get container status \"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b\": rpc error: code = NotFound desc = could not find container \"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b\": container with ID starting with bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b not found: ID does not exist" Jun 11 16:23:04.681153 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681100 2557 scope.go:117] "RemoveContainer" containerID="0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" Jun 11 16:23:04.681320 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.681303 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a\": container with ID starting with 0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a not found: ID does not exist" containerID="0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" Jun 11 16:23:04.681380 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681321 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a"} err="failed to get container status \"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a\": rpc error: code = NotFound desc = could not find container \"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a\": container with ID starting with 0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a not found: ID does not exist" Jun 11 16:23:04.681380 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681333 2557 scope.go:117] "RemoveContainer" containerID="3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" Jun 11 16:23:04.681477 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681451 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config" (OuterVolumeSpecName: "web-config") pod "93c571b0-4f13-4848-ab92-37f55328b4c7" (UID: "93c571b0-4f13-4848-ab92-37f55328b4c7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:04.681521 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.681510 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a\": container with ID starting with 3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a not found: ID does not exist" containerID="3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" Jun 11 16:23:04.681557 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681526 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a"} err="failed to get container status \"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a\": rpc error: code = NotFound desc = could not find container \"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a\": container with ID starting with 3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a not found: ID does not exist" Jun 11 16:23:04.681557 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681537 2557 scope.go:117] "RemoveContainer" containerID="2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" Jun 11 16:23:04.681711 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.681697 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54\": container with ID starting with 2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54 not found: ID does not exist" containerID="2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" Jun 11 16:23:04.681745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681713 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54"} err="failed to get container status \"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54\": rpc error: code = NotFound desc = could not find container \"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54\": container with ID starting with 2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54 not found: ID does not exist" Jun 11 16:23:04.681745 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681723 2557 scope.go:117] "RemoveContainer" containerID="23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" Jun 11 16:23:04.681976 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.681950 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28\": container with ID starting with 23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28 not found: ID does not exist" containerID="23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" Jun 11 16:23:04.682052 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.681985 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28"} err="failed to get container status \"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28\": rpc error: code = NotFound desc = could not find container \"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28\": container with ID starting with 23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28 not found: ID does not exist" Jun 11 16:23:04.682052 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682006 2557 scope.go:117] "RemoveContainer" containerID="c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891" Jun 11 16:23:04.682226 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:04.682210 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891\": container with ID starting with c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891 not found: ID does not exist" containerID="c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891" Jun 11 16:23:04.682257 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682229 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891"} err="failed to get container status \"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891\": rpc error: code = NotFound desc = could not find container \"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891\": container with ID starting with c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891 not found: ID does not exist" Jun 11 16:23:04.682257 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682240 2557 scope.go:117] "RemoveContainer" containerID="741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee" Jun 11 16:23:04.682469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682450 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee"} err="failed to get container status \"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee\": rpc error: code = NotFound desc = could not find container \"741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee\": container with ID starting with 741dc847de55255ebc1b9a651a3128a6ff162ba9a9a3920279b62d593b68c4ee not found: ID does not exist" Jun 11 16:23:04.682514 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682472 2557 scope.go:117] "RemoveContainer" containerID="bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b" Jun 11 16:23:04.682671 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682650 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b"} err="failed to get container status \"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b\": rpc error: code = NotFound desc = could not find container \"bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b\": container with ID starting with bc3f18ed5954bbdeabd3fb00186efe3c145d040f6a92b8779ebf430cde50f20b not found: ID does not exist" Jun 11 16:23:04.682721 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682672 2557 scope.go:117] "RemoveContainer" containerID="0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a" Jun 11 16:23:04.682939 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682920 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a"} err="failed to get container status \"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a\": rpc error: code = NotFound desc = could not find container \"0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a\": container with ID starting with 0b8d66453fef1ba4ac30df3a4fdfda38bbb94118b200bac3b468ac1ef5a2227a not found: ID does not exist" Jun 11 16:23:04.683001 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.682939 2557 scope.go:117] "RemoveContainer" containerID="3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a" Jun 11 16:23:04.683158 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683141 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a"} err="failed to get container status \"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a\": rpc error: code = NotFound desc = could not find container \"3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a\": container with ID starting with 3ff49e949acd98d789064edc4846ce25391aed54d51c9ae3b4935b27d716729a not found: ID does not exist" Jun 11 16:23:04.683202 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683158 2557 scope.go:117] "RemoveContainer" containerID="2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54" Jun 11 16:23:04.683367 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683345 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54"} err="failed to get container status \"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54\": rpc error: code = NotFound desc = could not find container \"2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54\": container with ID starting with 2578200b2bc9be4cfc012e59ea0ded76cda42e22afed602c4f9aabfbbe917c54 not found: ID does not exist" Jun 11 16:23:04.683443 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683369 2557 scope.go:117] "RemoveContainer" containerID="23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28" Jun 11 16:23:04.683587 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683572 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28"} err="failed to get container status \"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28\": rpc error: code = NotFound desc = could not find container \"23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28\": container with ID starting with 23006ee0110aa21dfc0572e2363efbc1b3040b25ead974c4bdf90d90a600bc28 not found: ID does not exist" Jun 11 16:23:04.683633 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683587 2557 scope.go:117] "RemoveContainer" containerID="c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891" Jun 11 16:23:04.683784 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.683766 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891"} err="failed to get container status \"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891\": rpc error: code = NotFound desc = could not find container \"c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891\": container with ID starting with c4591b6029726942b9ed05d4d319aba481595a1728d1f60090c669e4b98a3891 not found: ID does not exist" Jun 11 16:23:04.767772 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767737 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-tls-assets\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.767772 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767768 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-config-volume\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.767772 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767781 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-main-tls\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767820 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767835 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767846 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93c571b0-4f13-4848-ab92-37f55328b4c7-config-out\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767857 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-cluster-tls-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767867 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9kjd\" (UniqueName: \"kubernetes.io/projected/93c571b0-4f13-4848-ab92-37f55328b4c7-kube-api-access-d9kjd\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767880 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.768039 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.767895 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93c571b0-4f13-4848-ab92-37f55328b4c7-web-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:04.948469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.948436 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:04.952703 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.952673 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:04.984295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984258 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:04.984662 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984643 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="prom-label-proxy" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984663 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="prom-label-proxy" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984680 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="init-config-reloader" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984689 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="init-config-reloader" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984702 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-metric" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984711 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-metric" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984729 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" containerName="console" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984737 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" containerName="console" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984747 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="config-reloader" Jun 11 16:23:04.984768 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984755 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="config-reloader" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984774 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="alertmanager" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984782 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="alertmanager" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984793 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-web" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984820 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-web" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984830 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984838 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984927 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-web" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984942 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984950 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="kube-rbac-proxy-metric" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984959 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bcbd91b-37c2-45b3-8703-0a8ce24c4f31" containerName="console" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984970 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="alertmanager" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984979 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="config-reloader" Jun 11 16:23:04.985212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.984987 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" containerName="prom-label-proxy" Jun 11 16:23:04.989025 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.989002 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:04.993176 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993150 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 16:23:04.993294 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993202 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 16:23:04.993294 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993201 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 16:23:04.993504 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993485 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 16:23:04.993575 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993521 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 16:23:04.993575 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993521 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 16:23:04.993884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993870 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 16:23:04.993947 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993928 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mzknt\"" Jun 11 16:23:04.994012 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.993996 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 16:23:04.999203 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:04.999176 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 16:23:05.008355 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.008321 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:05.071368 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071368 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071433 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071582 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-web-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071885 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-out\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071885 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071885 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071885 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh45g\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-kube-api-access-qh45g\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.071885 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.071763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173170 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173217 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-web-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-out\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173527 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh45g\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-kube-api-access-qh45g\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.173884 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.173554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.174603 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.174568 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176332 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176209 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-out\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176431 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176403 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176781 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176540 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176781 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176596 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176781 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176716 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176781 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0abc25ed-b6fa-45ae-880e-ba71026f85e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.176781 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176754 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.177021 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.176851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.177100 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.177082 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-web-config\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.177134 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.177116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0abc25ed-b6fa-45ae-880e-ba71026f85e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.178272 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.178249 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0abc25ed-b6fa-45ae-880e-ba71026f85e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.185019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.184966 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh45g\" (UniqueName: \"kubernetes.io/projected/0abc25ed-b6fa-45ae-880e-ba71026f85e6-kube-api-access-qh45g\") pod \"alertmanager-main-0\" (UID: \"0abc25ed-b6fa-45ae-880e-ba71026f85e6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.298910 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.298866 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:23:05.440241 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.440001 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:23:05.442793 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:23:05.442765 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abc25ed_b6fa_45ae_880e_ba71026f85e6.slice/crio-e2dcdd78d72d879ec8e2ea0be2cce10849fb9d1bb51dbc59fa0fa5aaaf28d443 WatchSource:0}: Error finding container e2dcdd78d72d879ec8e2ea0be2cce10849fb9d1bb51dbc59fa0fa5aaaf28d443: Status 404 returned error can't find the container with id e2dcdd78d72d879ec8e2ea0be2cce10849fb9d1bb51dbc59fa0fa5aaaf28d443 Jun 11 16:23:05.631146 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.631116 2557 generic.go:356] "Generic (PLEG): container finished" podID="0abc25ed-b6fa-45ae-880e-ba71026f85e6" containerID="90135159712dd47a08af3b16b8d0bb3b4f0f6f6f0193c1981f2f9250f5131512" exitCode=0 Jun 11 16:23:05.631597 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.631201 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerDied","Data":"90135159712dd47a08af3b16b8d0bb3b4f0f6f6f0193c1981f2f9250f5131512"} Jun 11 16:23:05.631597 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:05.631280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"e2dcdd78d72d879ec8e2ea0be2cce10849fb9d1bb51dbc59fa0fa5aaaf28d443"} Jun 11 16:23:06.538021 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.537987 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c571b0-4f13-4848-ab92-37f55328b4c7" path="/var/lib/kubelet/pods/93c571b0-4f13-4848-ab92-37f55328b4c7/volumes" Jun 11 16:23:06.639492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"1a15f6e01a96408511555f35fdf8d1fb289c8716c91d7cf15870366c9c38f7de"} Jun 11 16:23:06.639848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"a50bed4b09e62284d41aa39595034e3d58ab6da1585d229075d11f80d0859400"} Jun 11 16:23:06.639848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639551 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"fcbabe3e6e97a08692edcc0987de5c9934cc66b62734711d4853606200dae101"} Jun 11 16:23:06.639848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639585 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"750364aed93a0109a7919bad92c4573d6ab0167a9b7f96e8208a83c0e06fd415"} Jun 11 16:23:06.639848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639613 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"32bad4cc287547ea83ed99b2b1b45c3ddc859976201c0b4467d5fdad7e51d0e6"} Jun 11 16:23:06.639848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.639636 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0abc25ed-b6fa-45ae-880e-ba71026f85e6","Type":"ContainerStarted","Data":"d54a207b42bd2dbe990f49d8481e1bf09d79e66fb32a90af4a3eccd356b2402c"} Jun 11 16:23:06.676533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:06.676484 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.660855428 podStartE2EDuration="2.676467515s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.612087ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:06.672728389 +0000 UTC m=+230.560333561" watchObservedRunningTime="2026-06-11 16:23:06.676467515 +0000 UTC m=+230.564072661" Jun 11 16:23:07.729277 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729238 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:07.729683 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729570 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="prometheus" containerID="cri-o://bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" gracePeriod=600 Jun 11 16:23:07.729683 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729616 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="thanos-sidecar" containerID="cri-o://675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" gracePeriod=600 Jun 11 16:23:07.729683 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729647 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-thanos" containerID="cri-o://30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" gracePeriod=600 Jun 11 16:23:07.729683 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729632 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-web" containerID="cri-o://1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" gracePeriod=600 Jun 11 16:23:07.729972 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729663 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="config-reloader" containerID="cri-o://e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" gracePeriod=600 Jun 11 16:23:07.729972 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.729595 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy" containerID="cri-o://ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" gracePeriod=600 Jun 11 16:23:07.972155 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:07.972125 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.104583 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104483 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104583 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104523 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104583 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104543 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104583 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104570 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104594 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104634 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104666 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104696 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104726 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104764 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104836 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104863 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104905 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.104933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104933 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104952 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.104989 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg9ch\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105000 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105015 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105037 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105072 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105119 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105122 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105152 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105181 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config\") pod \"98d15502-cc84-4d2e-987c-44914c6d0864\" (UID: \"98d15502-cc84-4d2e-987c-44914c6d0864\") " Jun 11 16:23:08.105418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105316 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105512 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105533 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105548 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105566 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105579 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-configmap-metrics-client-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.105985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.105863 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.106409 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.106382 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:08.107273 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.107239 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.108090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.107917 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.108090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.108009 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:23:08.108090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.108067 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:08.108893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.108858 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.108993 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.108906 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.109215 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.109190 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch" (OuterVolumeSpecName: "kube-api-access-cg9ch") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "kube-api-access-cg9ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:08.109396 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.109371 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.109461 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.109424 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.109866 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.109839 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.110048 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.110020 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out" (OuterVolumeSpecName: "config-out") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:23:08.110231 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.110204 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config" (OuterVolumeSpecName: "config") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.120606 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.120579 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config" (OuterVolumeSpecName: "web-config") pod "98d15502-cc84-4d2e-987c-44914c6d0864" (UID: "98d15502-cc84-4d2e-987c-44914c6d0864"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:08.206333 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206285 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206333 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206323 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206333 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206335 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-web-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206333 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206346 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-kube-rbac-proxy\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206358 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206370 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206383 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-config-out\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206393 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-db\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206404 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206416 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-grpc-tls\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206428 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206440 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-tls-assets\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206453 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98d15502-cc84-4d2e-987c-44914c6d0864-secret-metrics-client-certs\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206465 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg9ch\" (UniqueName: \"kubernetes.io/projected/98d15502-cc84-4d2e-987c-44914c6d0864-kube-api-access-cg9ch\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.206628 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.206477 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/98d15502-cc84-4d2e-987c-44914c6d0864-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:08.651029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.650995 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" exitCode=0 Jun 11 16:23:08.651029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651021 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" exitCode=0 Jun 11 16:23:08.651029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651028 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" exitCode=0 Jun 11 16:23:08.651029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651037 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" exitCode=0 Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651045 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" exitCode=0 Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651054 2557 generic.go:356] "Generic (PLEG): container finished" podID="98d15502-cc84-4d2e-987c-44914c6d0864" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" exitCode=0 Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651066 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651133 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651175 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651199 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651214 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651296 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} Jun 11 16:23:08.651362 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.651339 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98d15502-cc84-4d2e-987c-44914c6d0864","Type":"ContainerDied","Data":"c62446cda508033a5753179663c9b0e0dadc131ce3b3bfe23df5282eb55756d3"} Jun 11 16:23:08.659209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.659186 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.666696 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.666679 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.674152 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.674135 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.681366 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.681346 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.688731 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.688712 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.692090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.692062 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:08.699078 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.698988 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:08.699919 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.699896 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.707365 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.707346 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.707634 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.707612 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.707675 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.707643 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.707675 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.707660 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.707900 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.707878 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.707985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.707908 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.707985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.707930 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.708167 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.708150 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.708212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708175 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.708212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708190 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.708372 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.708357 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.708412 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708376 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.708412 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708390 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.708612 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.708599 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.708659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708613 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.708659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708624 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.708869 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.708851 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.708926 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708879 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.708926 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.708901 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.709153 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:08.709136 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.709264 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709159 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.709264 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709195 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.709412 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709396 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.709480 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709416 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.709636 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709619 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.709686 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709637 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.709849 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709826 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.709904 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.709851 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.710070 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710051 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.710108 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710071 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.710274 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710256 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.710321 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710275 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.710461 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710447 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.710461 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710461 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.710690 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710672 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.710743 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710691 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.710935 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710919 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.710935 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.710934 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.711136 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711118 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.711179 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711137 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.711349 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711333 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.711397 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711349 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.711550 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711534 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.711591 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711551 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.711736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711721 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.711773 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711736 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.711953 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711933 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.712001 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.711954 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.712170 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712154 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.712207 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712170 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.712372 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712358 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.712372 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712370 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.712576 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712558 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.712624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712576 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.712792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712773 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.712792 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.712794 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.713030 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713013 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.713067 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713030 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.713248 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713234 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.713298 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713248 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.713445 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713416 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.713498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713447 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.713652 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713636 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.713695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713653 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.713848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713831 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.713944 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.713848 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.714093 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714079 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.714137 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714093 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.714269 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714254 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.714312 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714269 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.714509 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714487 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.714572 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714510 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.714728 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714708 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.714773 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714729 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.714932 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714917 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.714932 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.714931 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.715103 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715087 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.715142 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715104 2557 scope.go:117] "RemoveContainer" containerID="30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6" Jun 11 16:23:08.715311 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715282 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6"} err="failed to get container status \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": rpc error: code = NotFound desc = could not find container \"30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6\": container with ID starting with 30b3bcdb933485d45f3ec095a2cabdf317a09c12e78db97f481d0693050471a6 not found: ID does not exist" Jun 11 16:23:08.715350 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715312 2557 scope.go:117] "RemoveContainer" containerID="ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f" Jun 11 16:23:08.715512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715497 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f"} err="failed to get container status \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": rpc error: code = NotFound desc = could not find container \"ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f\": container with ID starting with ad0d587124edb2cdcd40a04d7f8faa83aec11f058f41b08ba63d54cb9a80d44f not found: ID does not exist" Jun 11 16:23:08.715558 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715512 2557 scope.go:117] "RemoveContainer" containerID="1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53" Jun 11 16:23:08.715689 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715673 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53"} err="failed to get container status \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": rpc error: code = NotFound desc = could not find container \"1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53\": container with ID starting with 1bd29bd5596c384ab6cb81dc93da403949394ce95ae7ba4aca11b6b51f525d53 not found: ID does not exist" Jun 11 16:23:08.715732 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715688 2557 scope.go:117] "RemoveContainer" containerID="675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977" Jun 11 16:23:08.715887 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715870 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977"} err="failed to get container status \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": rpc error: code = NotFound desc = could not find container \"675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977\": container with ID starting with 675938726acdf3416d4f029b5659a9bf4ac4b9e8ad17dd34cae5e1ee5818e977 not found: ID does not exist" Jun 11 16:23:08.715928 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.715889 2557 scope.go:117] "RemoveContainer" containerID="e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da" Jun 11 16:23:08.716065 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.716050 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da"} err="failed to get container status \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": rpc error: code = NotFound desc = could not find container \"e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da\": container with ID starting with e1492cd2e10d005b5af8be909e8c06da839c0646016510150cb05618a42fa7da not found: ID does not exist" Jun 11 16:23:08.716113 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.716064 2557 scope.go:117] "RemoveContainer" containerID="bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d" Jun 11 16:23:08.716233 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.716218 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d"} err="failed to get container status \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": rpc error: code = NotFound desc = could not find container \"bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d\": container with ID starting with bcb9da809e1df6f83173c20d8e8c3ea57f1042f86f454015343b6c998b63fd4d not found: ID does not exist" Jun 11 16:23:08.716274 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.716233 2557 scope.go:117] "RemoveContainer" containerID="80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc" Jun 11 16:23:08.716395 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.716379 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc"} err="failed to get container status \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": rpc error: code = NotFound desc = could not find container \"80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc\": container with ID starting with 80168f5d63f627eb15075288836d595642bd72e8291956fef5c1b303400f04fc not found: ID does not exist" Jun 11 16:23:08.740473 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740434 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:08.740828 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740773 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="thanos-sidecar" Jun 11 16:23:08.740828 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740785 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="thanos-sidecar" Jun 11 16:23:08.740828 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740807 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-web" Jun 11 16:23:08.740828 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740814 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-web" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740831 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="config-reloader" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740839 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="config-reloader" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740852 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740858 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740864 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="prometheus" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740870 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="prometheus" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740878 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="init-config-reloader" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740883 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="init-config-reloader" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740891 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-thanos" Jun 11 16:23:08.740956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740895 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-thanos" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740966 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="prometheus" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740973 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="config-reloader" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740980 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740987 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="thanos-sidecar" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.740993 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-thanos" Jun 11 16:23:08.741220 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.741004 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" containerName="kube-rbac-proxy-web" Jun 11 16:23:08.743367 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.743348 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.754069 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.754043 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 16:23:08.754567 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.754548 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 16:23:08.754652 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.754552 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f0stce5i59g3m\"" Jun 11 16:23:08.755084 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755062 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 16:23:08.755246 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755117 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 16:23:08.755246 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755130 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 16:23:08.755246 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755070 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lb2jt\"" Jun 11 16:23:08.755246 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755069 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 16:23:08.755491 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755471 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 16:23:08.755718 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755678 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 16:23:08.755718 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755712 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:23:08.755888 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755767 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 16:23:08.755888 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755784 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 16:23:08.755986 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.755955 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 16:23:08.757669 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.757650 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 16:23:08.758684 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.758666 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 16:23:08.763229 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.763210 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 16:23:08.768180 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.768154 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:08.811563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-config-out\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811535 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99tr\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-kube-api-access-m99tr\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811637 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811674 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-web-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.811846 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.811975 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.812020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.812034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.812055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.812133 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.812069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.913847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.913980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914032 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914144 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-config-out\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99tr\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-kube-api-access-m99tr\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.917713 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-web-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.918588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.918588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.918588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914608 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.918588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.914636 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.918588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.916077 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.919771 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.919735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.920013 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.919986 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.920206 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.920180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.920624 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.920440 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.921742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.921497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.921742 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.921509 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.922124 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.922063 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.922832 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.922502 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600de235-fce2-4e01-bdc7-3980c3309798-config-out\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.922832 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.922823 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.923065 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.923039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.923392 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.923359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.924240 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.924194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.925027 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.924580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.925027 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.924935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600de235-fce2-4e01-bdc7-3980c3309798-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.925027 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.924986 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.925202 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.925039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-web-config\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.925202 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.925158 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600de235-fce2-4e01-bdc7-3980c3309798-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:08.928055 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:08.928035 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99tr\" (UniqueName: \"kubernetes.io/projected/600de235-fce2-4e01-bdc7-3980c3309798-kube-api-access-m99tr\") pod \"prometheus-k8s-0\" (UID: \"600de235-fce2-4e01-bdc7-3980c3309798\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:09.064123 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:09.064012 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:09.213478 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:09.213439 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:23:09.216015 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:23:09.215985 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600de235_fce2_4e01_bdc7_3980c3309798.slice/crio-640a163ecdd1550082588c5d3495a32e2aa10da23e4ae739715e8b9ef026fa1a WatchSource:0}: Error finding container 640a163ecdd1550082588c5d3495a32e2aa10da23e4ae739715e8b9ef026fa1a: Status 404 returned error can't find the container with id 640a163ecdd1550082588c5d3495a32e2aa10da23e4ae739715e8b9ef026fa1a Jun 11 16:23:09.657100 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:09.657064 2557 generic.go:356] "Generic (PLEG): container finished" podID="600de235-fce2-4e01-bdc7-3980c3309798" containerID="791f2fb87882754587c073376a1c73f495ef342e68bf217713e4e3fb38da733b" exitCode=0 Jun 11 16:23:09.657287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:09.657153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerDied","Data":"791f2fb87882754587c073376a1c73f495ef342e68bf217713e4e3fb38da733b"} Jun 11 16:23:09.657287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:09.657222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"640a163ecdd1550082588c5d3495a32e2aa10da23e4ae739715e8b9ef026fa1a"} Jun 11 16:23:10.538586 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.538546 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d15502-cc84-4d2e-987c-44914c6d0864" path="/var/lib/kubelet/pods/98d15502-cc84-4d2e-987c-44914c6d0864/volumes" Jun 11 16:23:10.667167 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"54a095998c8893333f2519e759d06efce84ea72d0a951d3a4e146827047f948e"} Jun 11 16:23:10.667347 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667208 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"6f8f7bbf255f4c9ba7f1c7a9328d9b96bf8a07279655824586e63dbf78ad3767"} Jun 11 16:23:10.667347 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667247 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"d547677be520f18e666afeaf51eab8aa56481fc1963616bed04213bdc5477b82"} Jun 11 16:23:10.667347 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"b4f5252c31c6c04811591dbedf4ef81cc8dc09b126413be91bcc6d3036ed066b"} Jun 11 16:23:10.667347 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667313 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"b654661809887c008356258d004591382f959d6f579102fdc36dfed19c51a063"} Jun 11 16:23:10.667531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.667349 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600de235-fce2-4e01-bdc7-3980c3309798","Type":"ContainerStarted","Data":"b34545e48bb038055a50eed0e2d9541d984f41d47c38add434f1803fcda377ed"} Jun 11 16:23:10.700272 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:10.700221 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.68092928 podStartE2EDuration="2.700199593s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.270313ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:10.69906784 +0000 UTC m=+234.586672987" watchObservedRunningTime="2026-06-11 16:23:10.700199593 +0000 UTC m=+234.587804740" Jun 11 16:23:14.064880 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:14.064848 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:23:24.339446 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:24.339412 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:23:49.359938 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.359870 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58bf6f595f-wccpn" podUID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" containerName="console" containerID="cri-o://7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9" gracePeriod=15 Jun 11 16:23:49.598145 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.598120 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:23:49.654085 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654057 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxxnn\" (UniqueName: \"kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654101 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654121 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654138 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654160 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654232 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654186 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654483 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654241 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca\") pod \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\" (UID: \"616c9966-8a2f-402e-afe7-fbaf3e23fdf6\") " Jun 11 16:23:49.654558 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654532 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config" (OuterVolumeSpecName: "console-config") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:49.654621 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654540 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:49.654758 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654729 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:49.654830 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.654786 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca" (OuterVolumeSpecName: "service-ca") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:23:49.656270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.656227 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:49.656270 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.656256 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn" (OuterVolumeSpecName: "kube-api-access-pxxnn") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "kube-api-access-pxxnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:49.656406 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.656298 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "616c9966-8a2f-402e-afe7-fbaf3e23fdf6" (UID: "616c9966-8a2f-402e-afe7-fbaf3e23fdf6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:49.755192 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755149 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxxnn\" (UniqueName: \"kubernetes.io/projected/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-kube-api-access-pxxnn\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755192 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755185 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-trusted-ca-bundle\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755192 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755200 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755213 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-oauth-config\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755225 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-console-serving-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755237 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-oauth-serving-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.755393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.755247 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/616c9966-8a2f-402e-afe7-fbaf3e23fdf6-service-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:23:49.827030 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.826996 2557 generic.go:356] "Generic (PLEG): container finished" podID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" containerID="7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9" exitCode=0 Jun 11 16:23:49.827164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.827046 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bf6f595f-wccpn" Jun 11 16:23:49.827164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.827057 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf6f595f-wccpn" event={"ID":"616c9966-8a2f-402e-afe7-fbaf3e23fdf6","Type":"ContainerDied","Data":"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9"} Jun 11 16:23:49.827164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.827105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bf6f595f-wccpn" event={"ID":"616c9966-8a2f-402e-afe7-fbaf3e23fdf6","Type":"ContainerDied","Data":"8d27ed7c02afc90fb32d926c6100f3d7f7ef9cdef676c6e5879ecb60c0a504d9"} Jun 11 16:23:49.827164 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.827132 2557 scope.go:117] "RemoveContainer" containerID="7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9" Jun 11 16:23:49.835715 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.835697 2557 scope.go:117] "RemoveContainer" containerID="7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9" Jun 11 16:23:49.835969 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:23:49.835951 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9\": container with ID starting with 7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9 not found: ID does not exist" containerID="7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9" Jun 11 16:23:49.836033 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.835977 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9"} err="failed to get container status \"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9\": rpc error: code = NotFound desc = could not find container \"7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9\": container with ID starting with 7458c02026cadde57d199f13c8edee812e9f7d90fba905077ad8b1fc34a4d9f9 not found: ID does not exist" Jun 11 16:23:49.848315 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.848292 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:23:49.853645 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:49.853624 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58bf6f595f-wccpn"] Jun 11 16:23:50.537188 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:23:50.537158 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" path="/var/lib/kubelet/pods/616c9966-8a2f-402e-afe7-fbaf3e23fdf6/volumes" Jun 11 16:24:09.065191 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:24:09.065156 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:24:09.080764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:24:09.080741 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:24:09.924219 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:24:09.924193 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:24:16.494849 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:24:16.494820 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:29:35.376736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.376697 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf"] Jun 11 16:29:35.377195 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.377049 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" containerName="console" Jun 11 16:29:35.377195 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.377061 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" containerName="console" Jun 11 16:29:35.377195 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.377110 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="616c9966-8a2f-402e-afe7-fbaf3e23fdf6" containerName="console" Jun 11 16:29:35.379078 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.379059 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.381707 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.381682 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:29:35.382522 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.382498 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:29:35.382631 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.382509 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:29:35.382631 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.382538 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:29:35.382631 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.382554 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:29:35.382631 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.382566 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mmps9\"" Jun 11 16:29:35.392893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.392869 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf"] Jun 11 16:29:35.518096 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.518055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvd7\" (UniqueName: \"kubernetes.io/projected/248f9166-2b1a-4596-b622-47e4fcdbe621-kube-api-access-bzvd7\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.518275 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.518117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-metrics-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.518275 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.518172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/248f9166-2b1a-4596-b622-47e4fcdbe621-manager-config\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.518275 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.518244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.619654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.619578 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvd7\" (UniqueName: \"kubernetes.io/projected/248f9166-2b1a-4596-b622-47e4fcdbe621-kube-api-access-bzvd7\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.619654 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.619632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-metrics-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.619933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.619664 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/248f9166-2b1a-4596-b622-47e4fcdbe621-manager-config\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.619933 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.619711 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.620285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.620261 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/248f9166-2b1a-4596-b622-47e4fcdbe621-manager-config\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.622071 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.622050 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-metrics-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.622145 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.622129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f9166-2b1a-4596-b622-47e4fcdbe621-cert\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.638615 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.638561 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvd7\" (UniqueName: \"kubernetes.io/projected/248f9166-2b1a-4596-b622-47e4fcdbe621-kube-api-access-bzvd7\") pod \"lws-controller-manager-7f7f9c74f-9l6xf\" (UID: \"248f9166-2b1a-4596-b622-47e4fcdbe621\") " pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.689307 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.689269 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:35.824730 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.824693 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf"] Jun 11 16:29:35.827811 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:29:35.827773 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248f9166_2b1a_4596_b622_47e4fcdbe621.slice/crio-ad79ed86394ec2b1082896f3a7a0e338e58360b5477b452ee30d79784685ac4a WatchSource:0}: Error finding container ad79ed86394ec2b1082896f3a7a0e338e58360b5477b452ee30d79784685ac4a: Status 404 returned error can't find the container with id ad79ed86394ec2b1082896f3a7a0e338e58360b5477b452ee30d79784685ac4a Jun 11 16:29:35.829722 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:35.829708 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:29:36.215289 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:36.215252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" event={"ID":"248f9166-2b1a-4596-b622-47e4fcdbe621","Type":"ContainerStarted","Data":"ad79ed86394ec2b1082896f3a7a0e338e58360b5477b452ee30d79784685ac4a"} Jun 11 16:29:38.960529 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.960487 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm"] Jun 11 16:29:38.963023 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.963005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:38.975837 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.975812 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:29:38.975950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.975852 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:29:38.975950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.975821 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:29:38.975950 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.975863 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:29:38.976074 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:38.976030 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n9hnv\"" Jun 11 16:29:39.008626 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.008594 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm"] Jun 11 16:29:39.053603 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.053557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.053762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.053630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.053762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.053672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r7lt\" (UniqueName: \"kubernetes.io/projected/250f6fa1-0ad5-4562-8a27-34bdd5360012-kube-api-access-5r7lt\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.053762 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.053732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.053893 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.053768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.154625 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.154588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.154625 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.154625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.154908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.154675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.154908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.154707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.154908 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.154742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r7lt\" (UniqueName: \"kubernetes.io/projected/250f6fa1-0ad5-4562-8a27-34bdd5360012-kube-api-access-5r7lt\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.155090 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.155051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.156945 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.156917 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250f6fa1-0ad5-4562-8a27-34bdd5360012-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.157152 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.157134 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.157222 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.157206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250f6fa1-0ad5-4562-8a27-34bdd5360012-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.163872 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.163852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r7lt\" (UniqueName: \"kubernetes.io/projected/250f6fa1-0ad5-4562-8a27-34bdd5360012-kube-api-access-5r7lt\") pod \"opendatahub-operator-controller-manager-74f85fbfb-kqnlm\" (UID: \"250f6fa1-0ad5-4562-8a27-34bdd5360012\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.231498 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.231409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" event={"ID":"248f9166-2b1a-4596-b622-47e4fcdbe621","Type":"ContainerStarted","Data":"a1c0798bc8d1768bb4f10dc442a49b8dd81573f10054422aee1f6f271b83eedc"} Jun 11 16:29:39.231644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.231553 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:39.258722 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.258678 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" podStartSLOduration=1.548392692 podStartE2EDuration="4.258663726s" totalImagesPullingTime="2.710271034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:39.257444237 +0000 UTC m=+623.145049361" watchObservedRunningTime="2026-06-11 16:29:39.258663726 +0000 UTC m=+623.146268871" Jun 11 16:29:39.273732 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.273704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:39.428490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:39.428456 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm"] Jun 11 16:29:39.432037 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:29:39.432011 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250f6fa1_0ad5_4562_8a27_34bdd5360012.slice/crio-045e35f780222d18c94fcfdbb4dd97ed8369d9443e3ba24463c66666467d2fd7 WatchSource:0}: Error finding container 045e35f780222d18c94fcfdbb4dd97ed8369d9443e3ba24463c66666467d2fd7: Status 404 returned error can't find the container with id 045e35f780222d18c94fcfdbb4dd97ed8369d9443e3ba24463c66666467d2fd7 Jun 11 16:29:40.239269 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:40.239216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" event={"ID":"250f6fa1-0ad5-4562-8a27-34bdd5360012","Type":"ContainerStarted","Data":"045e35f780222d18c94fcfdbb4dd97ed8369d9443e3ba24463c66666467d2fd7"} Jun 11 16:29:43.256061 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:43.256026 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" event={"ID":"250f6fa1-0ad5-4562-8a27-34bdd5360012","Type":"ContainerStarted","Data":"10ae18c47b40f363abb1eb1a03a976fc7ec063abbd622f481ac65d856aa363a4"} Jun 11 16:29:44.262218 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:44.262182 2557 generic.go:356] "Generic (PLEG): container finished" podID="250f6fa1-0ad5-4562-8a27-34bdd5360012" containerID="10ae18c47b40f363abb1eb1a03a976fc7ec063abbd622f481ac65d856aa363a4" exitCode=0 Jun 11 16:29:44.262682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:44.262268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" event={"ID":"250f6fa1-0ad5-4562-8a27-34bdd5360012","Type":"ContainerDied","Data":"10ae18c47b40f363abb1eb1a03a976fc7ec063abbd622f481ac65d856aa363a4"} Jun 11 16:29:45.268069 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:45.268030 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" event={"ID":"250f6fa1-0ad5-4562-8a27-34bdd5360012","Type":"ContainerStarted","Data":"055f9a8ce3c21603efd441279a2d14fa5f802718a0e35003de4f12833fd91670"} Jun 11 16:29:45.268535 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:45.268181 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:45.292586 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:45.292535 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" podStartSLOduration=3.075013967 podStartE2EDuration="7.292519976s" totalImagesPullingTime="3.263163299s" totalInitContainerRuntime="954.34271ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:45.290207425 +0000 UTC m=+629.177812582" watchObservedRunningTime="2026-06-11 16:29:45.292519976 +0000 UTC m=+629.180125121" Jun 11 16:29:50.242197 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:50.242165 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f7f9c74f-9l6xf" Jun 11 16:29:56.275442 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:56.275408 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-kqnlm" Jun 11 16:29:58.656349 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.656314 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c"] Jun 11 16:29:58.750657 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.750614 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c"] Jun 11 16:29:58.750867 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.750749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.755691 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.755666 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:29:58.756277 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.756259 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 16:29:58.756339 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.756267 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:29:58.758250 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.758231 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:29:58.759176 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.759156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g9kck\"" Jun 11 16:29:58.830025 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.829983 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nhm\" (UniqueName: \"kubernetes.io/projected/4a60e518-a9fc-4d46-a9b8-94985a7f557c-kube-api-access-t9nhm\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.830217 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.830038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tmp\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.830217 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.830132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tls-certs\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.931487 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.931398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tmp\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.931487 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.931471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tls-certs\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.931682 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.931504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nhm\" (UniqueName: \"kubernetes.io/projected/4a60e518-a9fc-4d46-a9b8-94985a7f557c-kube-api-access-t9nhm\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.933778 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.933751 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tmp\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.933944 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.933925 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a60e518-a9fc-4d46-a9b8-94985a7f557c-tls-certs\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:58.944194 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:58.944168 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nhm\" (UniqueName: \"kubernetes.io/projected/4a60e518-a9fc-4d46-a9b8-94985a7f557c-kube-api-access-t9nhm\") pod \"kube-auth-proxy-75d74779d6-9wt8c\" (UID: \"4a60e518-a9fc-4d46-a9b8-94985a7f557c\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:59.061490 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:59.061454 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" Jun 11 16:29:59.205605 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:59.205524 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c"] Jun 11 16:29:59.209184 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:29:59.209152 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a60e518_a9fc_4d46_a9b8_94985a7f557c.slice/crio-018cf7c4c62276e3e5f8d056b55c7420be60cff491806565f47c24a24bf0c025 WatchSource:0}: Error finding container 018cf7c4c62276e3e5f8d056b55c7420be60cff491806565f47c24a24bf0c025: Status 404 returned error can't find the container with id 018cf7c4c62276e3e5f8d056b55c7420be60cff491806565f47c24a24bf0c025 Jun 11 16:29:59.334371 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:29:59.334333 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" event={"ID":"4a60e518-a9fc-4d46-a9b8-94985a7f557c","Type":"ContainerStarted","Data":"018cf7c4c62276e3e5f8d056b55c7420be60cff491806565f47c24a24bf0c025"} Jun 11 16:30:02.351408 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:30:02.351375 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" event={"ID":"4a60e518-a9fc-4d46-a9b8-94985a7f557c","Type":"ContainerStarted","Data":"c52cf8026ffa3af217ad3775f1891c108eb3d537a42d3c8a1be5e55957e233d2"} Jun 11 16:30:02.371116 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:30:02.371017 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75d74779d6-9wt8c" podStartSLOduration=1.460621824 podStartE2EDuration="4.371001901s" totalImagesPullingTime="2.910380077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:02.370128305 +0000 UTC m=+646.257733477" watchObservedRunningTime="2026-06-11 16:30:02.371001901 +0000 UTC m=+646.258607043" Jun 11 16:31:40.974204 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.974175 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj"] Jun 11 16:31:40.977322 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.977303 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:40.979732 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.979708 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:31:40.980344 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.980329 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tz6jl\"" Jun 11 16:31:40.980418 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.980356 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:31:40.989046 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:40.989023 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj"] Jun 11 16:31:41.052555 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.052520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjhv\" (UniqueName: \"kubernetes.io/projected/a03fb5e2-c47c-48e0-bcd4-76448345f105-kube-api-access-tpjhv\") pod \"authorino-operator-75cc8d5cb7-nqdhj\" (UID: \"a03fb5e2-c47c-48e0-bcd4-76448345f105\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:41.153644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.153600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjhv\" (UniqueName: \"kubernetes.io/projected/a03fb5e2-c47c-48e0-bcd4-76448345f105-kube-api-access-tpjhv\") pod \"authorino-operator-75cc8d5cb7-nqdhj\" (UID: \"a03fb5e2-c47c-48e0-bcd4-76448345f105\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:41.165136 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.165104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjhv\" (UniqueName: \"kubernetes.io/projected/a03fb5e2-c47c-48e0-bcd4-76448345f105-kube-api-access-tpjhv\") pod \"authorino-operator-75cc8d5cb7-nqdhj\" (UID: \"a03fb5e2-c47c-48e0-bcd4-76448345f105\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:41.287824 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.287713 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:41.424914 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.424888 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj"] Jun 11 16:31:41.427448 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:31:41.427418 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03fb5e2_c47c_48e0_bcd4_76448345f105.slice/crio-a758417692da1c3aa112f4009774039a1e3b0742d8803c36f6d7fb78ba0836d4 WatchSource:0}: Error finding container a758417692da1c3aa112f4009774039a1e3b0742d8803c36f6d7fb78ba0836d4: Status 404 returned error can't find the container with id a758417692da1c3aa112f4009774039a1e3b0742d8803c36f6d7fb78ba0836d4 Jun 11 16:31:41.799185 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:41.799146 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" event={"ID":"a03fb5e2-c47c-48e0-bcd4-76448345f105","Type":"ContainerStarted","Data":"a758417692da1c3aa112f4009774039a1e3b0742d8803c36f6d7fb78ba0836d4"} Jun 11 16:31:45.820361 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:45.820273 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" event={"ID":"a03fb5e2-c47c-48e0-bcd4-76448345f105","Type":"ContainerStarted","Data":"2d360fdef49cbc96baf60ecdaa7b174d8353501a677c1da165382c897cb7df58"} Jun 11 16:31:45.820731 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:45.820374 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:31:45.840619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:45.840572 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" podStartSLOduration=1.8920282739999998 podStartE2EDuration="5.840557687s" totalImagesPullingTime="3.948529413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:45.839920648 +0000 UTC m=+749.727525800" watchObservedRunningTime="2026-06-11 16:31:45.840557687 +0000 UTC m=+749.728162835" Jun 11 16:31:56.827673 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:31:56.827641 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nqdhj" Jun 11 16:32:42.072513 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.072476 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:32:42.075779 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.075761 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.078057 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.078040 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bwrvp\"" Jun 11 16:32:42.078139 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.078062 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:32:42.084610 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.084588 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:32:42.096822 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.096780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1e7370e-ebe5-475a-b465-38d8158dcb84-config-file\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.096920 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.096860 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsjk\" (UniqueName: \"kubernetes.io/projected/f1e7370e-ebe5-475a-b465-38d8158dcb84-kube-api-access-frsjk\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.125976 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.125945 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:32:42.198289 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.198254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1e7370e-ebe5-475a-b465-38d8158dcb84-config-file\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.198455 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.198304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frsjk\" (UniqueName: \"kubernetes.io/projected/f1e7370e-ebe5-475a-b465-38d8158dcb84-kube-api-access-frsjk\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.198957 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.198934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1e7370e-ebe5-475a-b465-38d8158dcb84-config-file\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.206436 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.206413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsjk\" (UniqueName: \"kubernetes.io/projected/f1e7370e-ebe5-475a-b465-38d8158dcb84-kube-api-access-frsjk\") pod \"limitador-limitador-54d6d988d5-lpcmj\" (UID: \"f1e7370e-ebe5-475a-b465-38d8158dcb84\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.387693 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.387664 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:42.521711 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.521655 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:32:42.524420 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:32:42.524393 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e7370e_ebe5_475a_b465_38d8158dcb84.slice/crio-6d6a01cf92f08557d509971ebffbc2b8c8b8a3e4010ca1ae0173943ef36eb6c0 WatchSource:0}: Error finding container 6d6a01cf92f08557d509971ebffbc2b8c8b8a3e4010ca1ae0173943ef36eb6c0: Status 404 returned error can't find the container with id 6d6a01cf92f08557d509971ebffbc2b8c8b8a3e4010ca1ae0173943ef36eb6c0 Jun 11 16:32:42.623341 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.623311 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:32:42.627717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.627699 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:32:42.629863 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.629847 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-txwjg\"" Jun 11 16:32:42.633717 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.633694 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:32:42.702982 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.702902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mpzl\" (UniqueName: \"kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl\") pod \"authorino-75d556bd77-4zwds\" (UID: \"e739570b-396f-4873-9f75-17b78f53c8b0\") " pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:32:42.803723 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.803694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mpzl\" (UniqueName: \"kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl\") pod \"authorino-75d556bd77-4zwds\" (UID: \"e739570b-396f-4873-9f75-17b78f53c8b0\") " pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:32:42.812119 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.812098 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mpzl\" (UniqueName: \"kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl\") pod \"authorino-75d556bd77-4zwds\" (UID: \"e739570b-396f-4873-9f75-17b78f53c8b0\") " pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:32:42.937787 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:42.937754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:32:43.081292 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:43.081230 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" event={"ID":"f1e7370e-ebe5-475a-b465-38d8158dcb84","Type":"ContainerStarted","Data":"6d6a01cf92f08557d509971ebffbc2b8c8b8a3e4010ca1ae0173943ef36eb6c0"} Jun 11 16:32:43.096292 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:43.096259 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:32:43.101070 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:32:43.101035 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode739570b_396f_4873_9f75_17b78f53c8b0.slice/crio-49588944c32e2e6dd28c77b20b1404814f882c35aeb3c883ea5a522166467915 WatchSource:0}: Error finding container 49588944c32e2e6dd28c77b20b1404814f882c35aeb3c883ea5a522166467915: Status 404 returned error can't find the container with id 49588944c32e2e6dd28c77b20b1404814f882c35aeb3c883ea5a522166467915 Jun 11 16:32:44.094980 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:44.094913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4zwds" event={"ID":"e739570b-396f-4873-9f75-17b78f53c8b0","Type":"ContainerStarted","Data":"49588944c32e2e6dd28c77b20b1404814f882c35aeb3c883ea5a522166467915"} Jun 11 16:32:47.111128 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:47.111087 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4zwds" event={"ID":"e739570b-396f-4873-9f75-17b78f53c8b0","Type":"ContainerStarted","Data":"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616"} Jun 11 16:32:47.112677 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:47.112650 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" event={"ID":"f1e7370e-ebe5-475a-b465-38d8158dcb84","Type":"ContainerStarted","Data":"ac4e7af16aea7ed6b371f9a4e9ab592b8248812712a8403276f229c7d9c7adca"} Jun 11 16:32:47.112809 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:47.112735 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:32:47.168779 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:47.168711 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4zwds" podStartSLOduration=1.329410134 podStartE2EDuration="5.168691296s" totalImagesPullingTime="3.839281162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:47.167252623 +0000 UTC m=+811.054857769" watchObservedRunningTime="2026-06-11 16:32:47.168691296 +0000 UTC m=+811.056296444" Jun 11 16:32:47.206644 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:47.206532 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" podStartSLOduration=0.790336803 podStartE2EDuration="5.206514547s" totalImagesPullingTime="4.416177744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:47.205617609 +0000 UTC m=+811.093222755" watchObservedRunningTime="2026-06-11 16:32:47.206514547 +0000 UTC m=+811.094119753" Jun 11 16:32:58.118985 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:32:58.118953 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lpcmj" Jun 11 16:34:08.389097 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.389060 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:08.391584 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.391564 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:08.459969 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.459935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:08.481761 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.481716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrgw\" (UniqueName: \"kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw\") pod \"authorino-5d4b67c446-5jn5k\" (UID: \"c308787d-0823-4d83-a87a-f86f7f338e70\") " pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:08.582556 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.582520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrgw\" (UniqueName: \"kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw\") pod \"authorino-5d4b67c446-5jn5k\" (UID: \"c308787d-0823-4d83-a87a-f86f7f338e70\") " pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:08.598373 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.598343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrgw\" (UniqueName: \"kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw\") pod \"authorino-5d4b67c446-5jn5k\" (UID: \"c308787d-0823-4d83-a87a-f86f7f338e70\") " pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:08.633737 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.633698 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:08.633982 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.633969 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:08.788291 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.788121 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:08.791193 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:34:08.791164 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc308787d_0823_4d83_a87a_f86f7f338e70.slice/crio-5a32112c21a8920e458e1f40078a453a1eaf1d37064839c5d884576718f179fe WatchSource:0}: Error finding container 5a32112c21a8920e458e1f40078a453a1eaf1d37064839c5d884576718f179fe: Status 404 returned error can't find the container with id 5a32112c21a8920e458e1f40078a453a1eaf1d37064839c5d884576718f179fe Jun 11 16:34:08.940676 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.940589 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:34:08.943104 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.943087 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:08.948747 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.948716 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 16:34:08.955460 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.955429 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:34:08.985452 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.985417 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:08.985632 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:08.985487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkht\" (UniqueName: \"kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.086209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.086181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkht\" (UniqueName: \"kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.086391 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.086253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.088657 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.088624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.100282 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.100258 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkht\" (UniqueName: \"kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht\") pod \"authorino-67c9bbfcff-rsv9v\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.253130 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.253043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:34:09.394659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.394523 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:34:09.397311 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:34:09.397280 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod385afa44_93e0_4368_8b64_ca2123d41269.slice/crio-21efc2002dfc1e54cdd9e59845828b2e24df5e4ad479b44815837698f8e048dc WatchSource:0}: Error finding container 21efc2002dfc1e54cdd9e59845828b2e24df5e4ad479b44815837698f8e048dc: Status 404 returned error can't find the container with id 21efc2002dfc1e54cdd9e59845828b2e24df5e4ad479b44815837698f8e048dc Jun 11 16:34:09.495150 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.495105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" event={"ID":"c308787d-0823-4d83-a87a-f86f7f338e70","Type":"ContainerStarted","Data":"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986"} Jun 11 16:34:09.495150 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.495151 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" event={"ID":"c308787d-0823-4d83-a87a-f86f7f338e70","Type":"ContainerStarted","Data":"5a32112c21a8920e458e1f40078a453a1eaf1d37064839c5d884576718f179fe"} Jun 11 16:34:09.495381 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.495105 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" podUID="c308787d-0823-4d83-a87a-f86f7f338e70" containerName="authorino" containerID="cri-o://36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986" gracePeriod=30 Jun 11 16:34:09.496305 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.496280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" event={"ID":"385afa44-93e0-4368-8b64-ca2123d41269","Type":"ContainerStarted","Data":"21efc2002dfc1e54cdd9e59845828b2e24df5e4ad479b44815837698f8e048dc"} Jun 11 16:34:09.525650 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.525599 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" podStartSLOduration=1.217212492 podStartE2EDuration="1.52558248s" totalImagesPullingTime="308.369988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:09.525071591 +0000 UTC m=+893.412676766" watchObservedRunningTime="2026-06-11 16:34:09.52558248 +0000 UTC m=+893.413187626" Jun 11 16:34:09.747019 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.746992 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:09.791438 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.791352 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mrgw\" (UniqueName: \"kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw\") pod \"c308787d-0823-4d83-a87a-f86f7f338e70\" (UID: \"c308787d-0823-4d83-a87a-f86f7f338e70\") " Jun 11 16:34:09.794422 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.794075 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw" (OuterVolumeSpecName: "kube-api-access-8mrgw") pod "c308787d-0823-4d83-a87a-f86f7f338e70" (UID: "c308787d-0823-4d83-a87a-f86f7f338e70"). InnerVolumeSpecName "kube-api-access-8mrgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:34:09.892198 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:09.892161 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mrgw\" (UniqueName: \"kubernetes.io/projected/c308787d-0823-4d83-a87a-f86f7f338e70-kube-api-access-8mrgw\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:34:10.502400 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.502357 2557 generic.go:356] "Generic (PLEG): container finished" podID="c308787d-0823-4d83-a87a-f86f7f338e70" containerID="36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986" exitCode=0 Jun 11 16:34:10.502400 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.502402 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" Jun 11 16:34:10.502969 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.502437 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" event={"ID":"c308787d-0823-4d83-a87a-f86f7f338e70","Type":"ContainerDied","Data":"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986"} Jun 11 16:34:10.502969 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.502481 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5jn5k" event={"ID":"c308787d-0823-4d83-a87a-f86f7f338e70","Type":"ContainerDied","Data":"5a32112c21a8920e458e1f40078a453a1eaf1d37064839c5d884576718f179fe"} Jun 11 16:34:10.502969 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.502498 2557 scope.go:117] "RemoveContainer" containerID="36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986" Jun 11 16:34:10.504360 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.504336 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" event={"ID":"385afa44-93e0-4368-8b64-ca2123d41269","Type":"ContainerStarted","Data":"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166"} Jun 11 16:34:10.511329 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.511303 2557 scope.go:117] "RemoveContainer" containerID="36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986" Jun 11 16:34:10.511599 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:34:10.511579 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986\": container with ID starting with 36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986 not found: ID does not exist" containerID="36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986" Jun 11 16:34:10.511660 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.511606 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986"} err="failed to get container status \"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986\": rpc error: code = NotFound desc = could not find container \"36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986\": container with ID starting with 36267e737bb0391b86e816ef99e2f55bd9ee3bf1e1e0977ccbbb74ed6882e986 not found: ID does not exist" Jun 11 16:34:10.537953 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.537900 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" podStartSLOduration=2.281643385 podStartE2EDuration="2.537882734s" totalImagesPullingTime="256.239349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:10.536738655 +0000 UTC m=+894.424343800" watchObservedRunningTime="2026-06-11 16:34:10.537882734 +0000 UTC m=+894.425487885" Jun 11 16:34:10.555112 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.555075 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:10.571818 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.567221 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5jn5k"] Jun 11 16:34:10.574344 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.574312 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:34:10.574522 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.574494 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4zwds" podUID="e739570b-396f-4873-9f75-17b78f53c8b0" containerName="authorino" containerID="cri-o://8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616" gracePeriod=30 Jun 11 16:34:10.827653 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.827627 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:34:10.900104 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.900068 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mpzl\" (UniqueName: \"kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl\") pod \"e739570b-396f-4873-9f75-17b78f53c8b0\" (UID: \"e739570b-396f-4873-9f75-17b78f53c8b0\") " Jun 11 16:34:10.902172 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:10.902145 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl" (OuterVolumeSpecName: "kube-api-access-8mpzl") pod "e739570b-396f-4873-9f75-17b78f53c8b0" (UID: "e739570b-396f-4873-9f75-17b78f53c8b0"). InnerVolumeSpecName "kube-api-access-8mpzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:34:11.001230 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.001200 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mpzl\" (UniqueName: \"kubernetes.io/projected/e739570b-396f-4873-9f75-17b78f53c8b0-kube-api-access-8mpzl\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:34:11.510419 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.510379 2557 generic.go:356] "Generic (PLEG): container finished" podID="e739570b-396f-4873-9f75-17b78f53c8b0" containerID="8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616" exitCode=0 Jun 11 16:34:11.510419 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.510423 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4zwds" Jun 11 16:34:11.510927 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.510456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4zwds" event={"ID":"e739570b-396f-4873-9f75-17b78f53c8b0","Type":"ContainerDied","Data":"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616"} Jun 11 16:34:11.510927 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.510502 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4zwds" event={"ID":"e739570b-396f-4873-9f75-17b78f53c8b0","Type":"ContainerDied","Data":"49588944c32e2e6dd28c77b20b1404814f882c35aeb3c883ea5a522166467915"} Jun 11 16:34:11.510927 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.510520 2557 scope.go:117] "RemoveContainer" containerID="8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616" Jun 11 16:34:11.519200 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.519178 2557 scope.go:117] "RemoveContainer" containerID="8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616" Jun 11 16:34:11.519503 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:34:11.519481 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616\": container with ID starting with 8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616 not found: ID does not exist" containerID="8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616" Jun 11 16:34:11.519555 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.519513 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616"} err="failed to get container status \"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616\": rpc error: code = NotFound desc = could not find container \"8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616\": container with ID starting with 8259254ebfd0e4d0ac145a31ec86de082283512b7f8337bb88dd176b70627616 not found: ID does not exist" Jun 11 16:34:11.534548 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.534520 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:34:11.538722 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:11.538698 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4zwds"] Jun 11 16:34:12.538817 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:12.538767 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c308787d-0823-4d83-a87a-f86f7f338e70" path="/var/lib/kubelet/pods/c308787d-0823-4d83-a87a-f86f7f338e70/volumes" Jun 11 16:34:12.539179 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:12.539125 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e739570b-396f-4873-9f75-17b78f53c8b0" path="/var/lib/kubelet/pods/e739570b-396f-4873-9f75-17b78f53c8b0/volumes" Jun 11 16:34:49.857201 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:34:49.857164 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:37:39.916153 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.916119 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:37:39.917569 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.917541 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c308787d-0823-4d83-a87a-f86f7f338e70" containerName="authorino" Jun 11 16:37:39.917720 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.917708 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c308787d-0823-4d83-a87a-f86f7f338e70" containerName="authorino" Jun 11 16:37:39.917854 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.917841 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e739570b-396f-4873-9f75-17b78f53c8b0" containerName="authorino" Jun 11 16:37:39.917935 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.917926 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e739570b-396f-4873-9f75-17b78f53c8b0" containerName="authorino" Jun 11 16:37:39.918190 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.918178 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e739570b-396f-4873-9f75-17b78f53c8b0" containerName="authorino" Jun 11 16:37:39.918287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.918277 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c308787d-0823-4d83-a87a-f86f7f338e70" containerName="authorino" Jun 11 16:37:39.923462 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.923437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:39.926576 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.926556 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 16:37:39.942008 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:39.941979 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:37:40.040393 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.040348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.040572 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.040463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9c6\" (UniqueName: \"kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.040572 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.040525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.141152 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.141112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.141350 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.141183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.141350 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.141228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9c6\" (UniqueName: \"kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.141853 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.141829 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.143848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.143820 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.151515 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.151490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9c6\" (UniqueName: \"kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6\") pod \"authorino-7bfff49599-qsm5c\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.232425 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.232341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:37:40.376407 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.376374 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:37:40.379507 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:37:40.379468 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod292606fb_e91a_481b_9c7c_c012978a7305.slice/crio-05dbe2da875dcdca82e0f75e46983931fc9d63bf7aadd6736fe4703912605265 WatchSource:0}: Error finding container 05dbe2da875dcdca82e0f75e46983931fc9d63bf7aadd6736fe4703912605265: Status 404 returned error can't find the container with id 05dbe2da875dcdca82e0f75e46983931fc9d63bf7aadd6736fe4703912605265 Jun 11 16:37:40.380736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.380717 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:37:40.497720 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:40.497641 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff49599-qsm5c" event={"ID":"292606fb-e91a-481b-9c7c-c012978a7305","Type":"ContainerStarted","Data":"05dbe2da875dcdca82e0f75e46983931fc9d63bf7aadd6736fe4703912605265"} Jun 11 16:37:41.503531 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.503488 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff49599-qsm5c" event={"ID":"292606fb-e91a-481b-9c7c-c012978a7305","Type":"ContainerStarted","Data":"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f"} Jun 11 16:37:41.525785 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.525740 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bfff49599-qsm5c" podStartSLOduration=2.159837665 podStartE2EDuration="2.525724233s" totalImagesPullingTime="365.886568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:41.52525113 +0000 UTC m=+1105.412856277" watchObservedRunningTime="2026-06-11 16:37:41.525724233 +0000 UTC m=+1105.413329386" Jun 11 16:37:41.565275 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.565242 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:37:41.565439 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.565417 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" podUID="385afa44-93e0-4368-8b64-ca2123d41269" containerName="authorino" containerID="cri-o://5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166" gracePeriod=30 Jun 11 16:37:41.811147 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.811119 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:37:41.857063 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.857031 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert\") pod \"385afa44-93e0-4368-8b64-ca2123d41269\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " Jun 11 16:37:41.857238 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.857086 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrkht\" (UniqueName: \"kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht\") pod \"385afa44-93e0-4368-8b64-ca2123d41269\" (UID: \"385afa44-93e0-4368-8b64-ca2123d41269\") " Jun 11 16:37:41.859145 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.859117 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht" (OuterVolumeSpecName: "kube-api-access-qrkht") pod "385afa44-93e0-4368-8b64-ca2123d41269" (UID: "385afa44-93e0-4368-8b64-ca2123d41269"). InnerVolumeSpecName "kube-api-access-qrkht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:37:41.867286 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.867259 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "385afa44-93e0-4368-8b64-ca2123d41269" (UID: "385afa44-93e0-4368-8b64-ca2123d41269"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:37:41.958648 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.958609 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/385afa44-93e0-4368-8b64-ca2123d41269-tls-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:37:41.958648 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:41.958640 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrkht\" (UniqueName: \"kubernetes.io/projected/385afa44-93e0-4368-8b64-ca2123d41269-kube-api-access-qrkht\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:37:42.509592 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.509499 2557 generic.go:356] "Generic (PLEG): container finished" podID="385afa44-93e0-4368-8b64-ca2123d41269" containerID="5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166" exitCode=0 Jun 11 16:37:42.509592 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.509542 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" Jun 11 16:37:42.509592 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.509575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" event={"ID":"385afa44-93e0-4368-8b64-ca2123d41269","Type":"ContainerDied","Data":"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166"} Jun 11 16:37:42.510154 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.509610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c9bbfcff-rsv9v" event={"ID":"385afa44-93e0-4368-8b64-ca2123d41269","Type":"ContainerDied","Data":"21efc2002dfc1e54cdd9e59845828b2e24df5e4ad479b44815837698f8e048dc"} Jun 11 16:37:42.510154 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.509633 2557 scope.go:117] "RemoveContainer" containerID="5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166" Jun 11 16:37:42.518715 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.518697 2557 scope.go:117] "RemoveContainer" containerID="5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166" Jun 11 16:37:42.519019 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:37:42.518999 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166\": container with ID starting with 5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166 not found: ID does not exist" containerID="5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166" Jun 11 16:37:42.519076 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.519027 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166"} err="failed to get container status \"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166\": rpc error: code = NotFound desc = could not find container \"5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166\": container with ID starting with 5a4d0618584c58c7f79264c7514c204838ce9cbecba6a0d7354ac84c7ec9d166 not found: ID does not exist" Jun 11 16:37:42.546380 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.546353 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:37:42.564563 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:42.564538 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67c9bbfcff-rsv9v"] Jun 11 16:37:44.538370 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:44.538337 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385afa44-93e0-4368-8b64-ca2123d41269" path="/var/lib/kubelet/pods/385afa44-93e0-4368-8b64-ca2123d41269/volumes" Jun 11 16:37:49.958107 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.958078 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g"] Jun 11 16:37:49.958549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.958425 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385afa44-93e0-4368-8b64-ca2123d41269" containerName="authorino" Jun 11 16:37:49.958549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.958436 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="385afa44-93e0-4368-8b64-ca2123d41269" containerName="authorino" Jun 11 16:37:49.958549 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.958507 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="385afa44-93e0-4368-8b64-ca2123d41269" containerName="authorino" Jun 11 16:37:49.962920 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.962899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:49.967236 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.967210 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lhsh5\"" Jun 11 16:37:49.967344 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.967289 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:37:49.967899 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.967884 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:37:49.968326 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.968312 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 16:37:49.983850 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:49.983826 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g"] Jun 11 16:37:50.030699 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.030848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030703 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf452\" (UniqueName: \"kubernetes.io/projected/4a850f5d-576b-4fd3-b469-505b211f17c4-kube-api-access-kf452\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.030848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.030848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.030848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.030989 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.030897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a850f5d-576b-4fd3-b469-505b211f17c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.131980 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.131944 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf452\" (UniqueName: \"kubernetes.io/projected/4a850f5d-576b-4fd3-b469-505b211f17c4-kube-api-access-kf452\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132062 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132098 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a850f5d-576b-4fd3-b469-505b211f17c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132209 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132495 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132495 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132444 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.132588 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.132511 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.134312 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.134285 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a850f5d-576b-4fd3-b469-505b211f17c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.134665 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.134647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a850f5d-576b-4fd3-b469-505b211f17c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.142287 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.142264 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf452\" (UniqueName: \"kubernetes.io/projected/4a850f5d-576b-4fd3-b469-505b211f17c4-kube-api-access-kf452\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g\" (UID: \"4a850f5d-576b-4fd3-b469-505b211f17c4\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.273372 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.273276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:37:50.452466 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:37:50.452430 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a850f5d_576b_4fd3_b469_505b211f17c4.slice/crio-c4609bc613f719f0a0154980ea6e6e24ef22c442d4c7b61f42c5ec543131a302 WatchSource:0}: Error finding container c4609bc613f719f0a0154980ea6e6e24ef22c442d4c7b61f42c5ec543131a302: Status 404 returned error can't find the container with id c4609bc613f719f0a0154980ea6e6e24ef22c442d4c7b61f42c5ec543131a302 Jun 11 16:37:50.456081 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.456055 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g"] Jun 11 16:37:50.524736 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.524652 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:37:50.547403 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:50.547356 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" event={"ID":"4a850f5d-576b-4fd3-b469-505b211f17c4","Type":"ContainerStarted","Data":"c4609bc613f719f0a0154980ea6e6e24ef22c442d4c7b61f42c5ec543131a302"} Jun 11 16:37:54.569421 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:54.569376 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" event={"ID":"4a850f5d-576b-4fd3-b469-505b211f17c4","Type":"ContainerStarted","Data":"08a81edfc65d0c3820f6189b00c9c66804676349f8d9ab5c5a1829e0ddb1f97a"} Jun 11 16:37:59.071844 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:37:59.071787 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:38:10.740970 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:10.740928 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:38:15.063899 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:15.063858 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:38:19.292212 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.292179 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88"] Jun 11 16:38:19.297198 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.297178 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.308123 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:38:19.308096 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" is forbidden: User \"system:node:ip-10-0-142-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-142-49.ec2.internal' and this object" podUID="8b44247d-6dd8-4494-9386-e3caebeb69ec" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.310963 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:38:19.310940 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"facebook-opt-125m-simulated-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-142-49.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-142-49.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" type="*v1.Secret" Jun 11 16:38:19.327177 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.327152 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88"] Jun 11 16:38:19.397454 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t887w\" (UniqueName: \"kubernetes.io/projected/8b44247d-6dd8-4494-9386-e3caebeb69ec-kube-api-access-t887w\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.397598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.397598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397490 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.397598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.397598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.397598 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.397592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b44247d-6dd8-4494-9386-e3caebeb69ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498424 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t887w\" (UniqueName: \"kubernetes.io/projected/8b44247d-6dd8-4494-9386-e3caebeb69ec-kube-api-access-t887w\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498424 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498427 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498642 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498642 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498642 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498642 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b44247d-6dd8-4494-9386-e3caebeb69ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498909 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498885 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498979 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.498979 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.498954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.500778 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.500756 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b44247d-6dd8-4494-9386-e3caebeb69ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:19.507819 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:19.507776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t887w\" (UniqueName: \"kubernetes.io/projected/8b44247d-6dd8-4494-9386-e3caebeb69ec-kube-api-access-t887w\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:20.401659 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.401624 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 16:38:20.411135 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.411106 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b44247d-6dd8-4494-9386-e3caebeb69ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-49v88\" (UID: \"8b44247d-6dd8-4494-9386-e3caebeb69ec\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:20.507575 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.507537 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:20.563968 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.563925 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:38:20.651601 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.651578 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88"] Jun 11 16:38:20.653680 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:38:20.653602 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b44247d_6dd8_4494_9386_e3caebeb69ec.slice/crio-fe3cd58e5b7e0d3661babe3587252f9f3fc437a965e2e42793b2495607cad881 WatchSource:0}: Error finding container fe3cd58e5b7e0d3661babe3587252f9f3fc437a965e2e42793b2495607cad881: Status 404 returned error can't find the container with id fe3cd58e5b7e0d3661babe3587252f9f3fc437a965e2e42793b2495607cad881 Jun 11 16:38:20.696532 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:20.696497 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" event={"ID":"8b44247d-6dd8-4494-9386-e3caebeb69ec","Type":"ContainerStarted","Data":"fe3cd58e5b7e0d3661babe3587252f9f3fc437a965e2e42793b2495607cad881"} Jun 11 16:38:21.702694 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:21.702655 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" event={"ID":"8b44247d-6dd8-4494-9386-e3caebeb69ec","Type":"ContainerStarted","Data":"75991a01223c7b49bdda1461e16ac87522a7e2ac0a3c4e6887d49db1aa5ec7ed"} Jun 11 16:38:22.709035 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:22.708999 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b44247d-6dd8-4494-9386-e3caebeb69ec" containerID="75991a01223c7b49bdda1461e16ac87522a7e2ac0a3c4e6887d49db1aa5ec7ed" exitCode=0 Jun 11 16:38:22.709511 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:22.709051 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" event={"ID":"8b44247d-6dd8-4494-9386-e3caebeb69ec","Type":"ContainerDied","Data":"75991a01223c7b49bdda1461e16ac87522a7e2ac0a3c4e6887d49db1aa5ec7ed"} Jun 11 16:38:24.237641 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.237607 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4"] Jun 11 16:38:24.241469 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.241443 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.244524 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.244501 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 16:38:24.252785 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.252761 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4"] Jun 11 16:38:24.338184 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.338184 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338184 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2c2b\" (UniqueName: \"kubernetes.io/projected/30bd6979-f2ae-44fa-99d0-0309661dfab1-kube-api-access-p2c2b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.338404 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.338404 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338317 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.338404 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.338512 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.338407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bd6979-f2ae-44fa-99d0-0309661dfab1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439271 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439473 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439473 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439355 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bd6979-f2ae-44fa-99d0-0309661dfab1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439473 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439473 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2c2b\" (UniqueName: \"kubernetes.io/projected/30bd6979-f2ae-44fa-99d0-0309661dfab1-kube-api-access-p2c2b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439687 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439746 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439690 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439833 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439741 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.439833 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.439760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.441568 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.441546 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bd6979-f2ae-44fa-99d0-0309661dfab1-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.441863 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.441847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bd6979-f2ae-44fa-99d0-0309661dfab1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.447955 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.447937 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2c2b\" (UniqueName: \"kubernetes.io/projected/30bd6979-f2ae-44fa-99d0-0309661dfab1-kube-api-access-p2c2b\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-rvjr4\" (UID: \"30bd6979-f2ae-44fa-99d0-0309661dfab1\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.551706 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.551624 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:38:24.685029 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.685004 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4"] Jun 11 16:38:24.687239 ip-10-0-142-49 kubenswrapper[2557]: W0611 16:38:24.687209 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bd6979_f2ae_44fa_99d0_0309661dfab1.slice/crio-477692ac2019ca780f7d4b993415203b5567b26ec4643e360e294e7607e28026 WatchSource:0}: Error finding container 477692ac2019ca780f7d4b993415203b5567b26ec4643e360e294e7607e28026: Status 404 returned error can't find the container with id 477692ac2019ca780f7d4b993415203b5567b26ec4643e360e294e7607e28026 Jun 11 16:38:24.719459 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.719427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" event={"ID":"8b44247d-6dd8-4494-9386-e3caebeb69ec","Type":"ContainerStarted","Data":"180756525c7431ed7823dba0c6ef8f6b645fd64aeadc44a815cf77018a5f84dd"} Jun 11 16:38:24.720519 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.720487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" event={"ID":"30bd6979-f2ae-44fa-99d0-0309661dfab1","Type":"ContainerStarted","Data":"477692ac2019ca780f7d4b993415203b5567b26ec4643e360e294e7607e28026"} Jun 11 16:38:24.740638 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:24.740584 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" podStartSLOduration=3.216483811 podStartE2EDuration="5.740567446s" totalImagesPullingTime="1.053080983s" totalInitContainerRuntime="1.471002652s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:38:24.739320049 +0000 UTC m=+1148.626925196" watchObservedRunningTime="2026-06-11 16:38:24.740567446 +0000 UTC m=+1148.628172586" Jun 11 16:38:25.495238 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:25.495200 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:38:25.727501 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:25.727462 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" event={"ID":"30bd6979-f2ae-44fa-99d0-0309661dfab1","Type":"ContainerStarted","Data":"920efd1e7ecaa8f7b352af334d0c5016df2f6f42fa2179df40692d481b9db914"} Jun 11 16:38:30.508062 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:30.508018 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:30.508472 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:30.508087 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:30.520647 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:30.520624 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:38:30.763148 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:38:30.763058 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-49v88" Jun 11 16:39:09.944096 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:09.944063 2557 generic.go:356] "Generic (PLEG): container finished" podID="30bd6979-f2ae-44fa-99d0-0309661dfab1" containerID="920efd1e7ecaa8f7b352af334d0c5016df2f6f42fa2179df40692d481b9db914" exitCode=0 Jun 11 16:39:09.944613 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:09.944139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" event={"ID":"30bd6979-f2ae-44fa-99d0-0309661dfab1","Type":"ContainerDied","Data":"920efd1e7ecaa8f7b352af334d0c5016df2f6f42fa2179df40692d481b9db914"} Jun 11 16:39:10.950632 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:10.950593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" event={"ID":"30bd6979-f2ae-44fa-99d0-0309661dfab1","Type":"ContainerStarted","Data":"7c7b1e4db25404da32f54941d3656f271ff3cd2d257912821b545186a36954dd"} Jun 11 16:39:10.975031 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:10.974983 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" podStartSLOduration=2.091546723 podStartE2EDuration="46.974967308s" totalImagesPullingTime="231.21276ms" totalInitContainerRuntime="44.652207825s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:10.972871575 +0000 UTC m=+1194.860476724" watchObservedRunningTime="2026-06-11 16:39:10.974967308 +0000 UTC m=+1194.862572454" Jun 11 16:39:14.552606 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:14.552574 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:39:14.553064 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:14.552615 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:39:14.564947 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:14.564923 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:39:14.983032 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:14.983002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-rvjr4" Jun 11 16:39:17.958825 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:17.955962 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:39:17.958825 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:17.956209 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bfff49599-qsm5c" podUID="292606fb-e91a-481b-9c7c-c012978a7305" containerName="authorino" containerID="cri-o://18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f" gracePeriod=30 Jun 11 16:39:18.211048 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.210986 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:39:18.327044 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.327015 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds9c6\" (UniqueName: \"kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6\") pod \"292606fb-e91a-481b-9c7c-c012978a7305\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " Jun 11 16:39:18.327233 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.327055 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert\") pod \"292606fb-e91a-481b-9c7c-c012978a7305\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " Jun 11 16:39:18.327233 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.327187 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca\") pod \"292606fb-e91a-481b-9c7c-c012978a7305\" (UID: \"292606fb-e91a-481b-9c7c-c012978a7305\") " Jun 11 16:39:18.329167 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.329133 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6" (OuterVolumeSpecName: "kube-api-access-ds9c6") pod "292606fb-e91a-481b-9c7c-c012978a7305" (UID: "292606fb-e91a-481b-9c7c-c012978a7305"). InnerVolumeSpecName "kube-api-access-ds9c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:39:18.332009 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.331982 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "292606fb-e91a-481b-9c7c-c012978a7305" (UID: "292606fb-e91a-481b-9c7c-c012978a7305"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:39:18.337102 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.337075 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "292606fb-e91a-481b-9c7c-c012978a7305" (UID: "292606fb-e91a-481b-9c7c-c012978a7305"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:39:18.428534 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.428505 2557 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/292606fb-e91a-481b-9c7c-c012978a7305-oidc-ca\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:39:18.428534 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.428529 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds9c6\" (UniqueName: \"kubernetes.io/projected/292606fb-e91a-481b-9c7c-c012978a7305-kube-api-access-ds9c6\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:39:18.428534 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.428540 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/292606fb-e91a-481b-9c7c-c012978a7305-tls-cert\") on node \"ip-10-0-142-49.ec2.internal\" DevicePath \"\"" Jun 11 16:39:18.993059 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.993026 2557 generic.go:356] "Generic (PLEG): container finished" podID="292606fb-e91a-481b-9c7c-c012978a7305" containerID="18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f" exitCode=0 Jun 11 16:39:18.993514 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.993066 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfff49599-qsm5c" Jun 11 16:39:18.993514 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.993118 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff49599-qsm5c" event={"ID":"292606fb-e91a-481b-9c7c-c012978a7305","Type":"ContainerDied","Data":"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f"} Jun 11 16:39:18.993514 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.993165 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bfff49599-qsm5c" event={"ID":"292606fb-e91a-481b-9c7c-c012978a7305","Type":"ContainerDied","Data":"05dbe2da875dcdca82e0f75e46983931fc9d63bf7aadd6736fe4703912605265"} Jun 11 16:39:18.993514 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:18.993195 2557 scope.go:117] "RemoveContainer" containerID="18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f" Jun 11 16:39:19.001835 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:19.001817 2557 scope.go:117] "RemoveContainer" containerID="18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f" Jun 11 16:39:19.002076 ip-10-0-142-49 kubenswrapper[2557]: E0611 16:39:19.002058 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f\": container with ID starting with 18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f not found: ID does not exist" containerID="18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f" Jun 11 16:39:19.002137 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:19.002084 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f"} err="failed to get container status \"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f\": rpc error: code = NotFound desc = could not find container \"18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f\": container with ID starting with 18c6c11099094a7e29994d3a217d4871eca3362358f15487eeea3e326b6dab9f not found: ID does not exist" Jun 11 16:39:19.010472 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:19.010449 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:39:19.013355 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:19.013336 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bfff49599-qsm5c"] Jun 11 16:39:20.538134 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:20.538103 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292606fb-e91a-481b-9c7c-c012978a7305" path="/var/lib/kubelet/pods/292606fb-e91a-481b-9c7c-c012978a7305/volumes" Jun 11 16:39:39.472044 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:39.472009 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:39:41.095416 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:41.095382 2557 generic.go:356] "Generic (PLEG): container finished" podID="4a850f5d-576b-4fd3-b469-505b211f17c4" containerID="08a81edfc65d0c3820f6189b00c9c66804676349f8d9ab5c5a1829e0ddb1f97a" exitCode=0 Jun 11 16:39:41.095771 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:41.095428 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" event={"ID":"4a850f5d-576b-4fd3-b469-505b211f17c4","Type":"ContainerDied","Data":"08a81edfc65d0c3820f6189b00c9c66804676349f8d9ab5c5a1829e0ddb1f97a"} Jun 11 16:39:42.102674 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:42.102633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" event={"ID":"4a850f5d-576b-4fd3-b469-505b211f17c4","Type":"ContainerStarted","Data":"67f1454c13b35746e57138dade5aae61db43e4b4c345e237b943cf0c0d53d186"} Jun 11 16:39:42.125009 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:42.124960 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" podStartSLOduration=2.392715107 podStartE2EDuration="1m53.124945148s" totalImagesPullingTime="4.188444155s" totalInitContainerRuntime="1m46.543785886s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:42.122643236 +0000 UTC m=+1226.010248383" watchObservedRunningTime="2026-06-11 16:39:42.124945148 +0000 UTC m=+1226.012550310" Jun 11 16:39:43.850494 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:43.850459 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:39:50.273857 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:50.273825 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:39:50.274295 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:50.273896 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:39:50.286153 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:50.286131 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:39:50.750176 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:50.750139 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:39:51.160506 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:39:51.160480 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g" Jun 11 16:40:00.546871 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:40:00.546838 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:40:09.885430 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:40:09.885357 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:40:20.364092 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:40:20.364053 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:40:29.166492 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:40:29.166458 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:40:39.171117 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:40:39.171082 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:41:11.287068 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:41:11.287033 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:41:15.561026 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:41:15.560990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:41:53.264837 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:41:53.264784 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:42:09.256970 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:42:09.256931 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:42:48.168935 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:42:48.168900 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:43:04.849292 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:43:04.849256 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:43:19.454820 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:43:19.454726 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:43:35.052956 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:43:35.052918 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:43:38.956848 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:43:38.956786 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:44:37.052445 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:44:37.052413 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:44:45.911045 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:44:45.911010 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:45:02.648075 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:45:02.648043 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:45:11.162286 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:45:11.162247 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:45:28.359049 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:45:28.359013 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:45:36.875060 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:45:36.875026 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:09.369938 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:09.369855 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:17.521350 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:17.521312 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:20.975738 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:20.975695 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:26.514817 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:26.514777 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:34.568914 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:34.568881 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:43.074901 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:43.074861 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:51.660973 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:51.660940 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:46:55.196555 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:46:55.196518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:47:08.869156 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:47:08.869116 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:47:22.899278 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:47:22.899237 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:48:13.310596 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:48:13.310559 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:48:21.153764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:48:21.153722 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:48:40.067852 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:48:40.067816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:48:48.673073 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:48:48.673033 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:48:57.694340 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:48:57.694304 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:06.170581 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:06.170501 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:15.593879 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:15.593845 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:24.148695 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:24.148664 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:32.952951 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:32.952915 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:40.859726 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:40.859682 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:49.854684 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:49.854642 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:49:58.153998 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:49:58.153960 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:52:26.982749 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:52:26.982662 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:52:31.462615 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:52:31.462575 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:52:57.758666 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:52:57.758621 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:02.167102 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:02.167053 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:12.071048 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:12.071008 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:20.869619 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:20.869581 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:31.884949 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:31.884913 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:40.477703 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:40.477667 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:53:50.457258 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:53:50.457217 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:54:00.071772 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:54:00.071735 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:54:09.851999 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:54:09.851961 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:54:19.252237 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:54:19.252201 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:54:28.169533 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:54:28.169496 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:54:33.356331 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:54:33.356299 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:55:01.088645 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:55:01.088605 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:55:45.164412 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:55:45.164372 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:55:52.993565 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:55:52.993525 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:02.560285 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:02.560244 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:10.159632 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:10.159596 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:19.499589 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:19.499543 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:31.073132 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:31.073093 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:41.348077 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:41.348031 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:44.863764 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:44.863730 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:56:55.752773 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:56:55.752733 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:03.050333 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:03.050287 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:11.163678 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:11.163640 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:21.556688 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:21.556646 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:40.456026 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:40.455991 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:47.164527 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:47.164484 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:57:57.758419 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:57:57.758385 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:05.365038 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:05.364990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:23.354319 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:23.354273 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:30.482389 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:30.482347 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:40.938251 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:40.938213 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:47.766372 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:47.766331 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:58:57.956007 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:58:57.955967 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:59:05.458104 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:59:05.458061 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:59:15.474302 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:59:15.474257 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:59:27.270141 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:59:27.270107 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:59:38.471221 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:59:38.471186 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 16:59:49.764914 ip-10-0-142-49 kubenswrapper[2557]: I0611 16:59:49.764868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:00.726863 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:00.726827 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:04.664437 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:04.664401 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:15.053039 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:15.053003 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:19.199658 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:19.199621 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:35.946289 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:35.946252 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:44.354889 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:44.354847 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:53.652544 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:53.652499 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:00:59.851670 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:00:59.851622 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:01:21.550681 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:01:21.550636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:01:34.059750 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:01:34.059710 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lpcmj"] Jun 11 17:02:14.116175 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:14.116144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-kqnlm_250f6fa1-0ad5-4562-8a27-34bdd5360012/copy-manifests/0.log" Jun 11 17:02:14.123076 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:14.123048 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-kqnlm_250f6fa1-0ad5-4562-8a27-34bdd5360012/manager/0.log" Jun 11 17:02:15.762542 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:15.762508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nqdhj_a03fb5e2-c47c-48e0-bcd4-76448345f105/manager/0.log" Jun 11 17:02:16.337498 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:16.337463 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lpcmj_f1e7370e-ebe5-475a-b465-38d8158dcb84/limitador/0.log" Jun 11 17:02:17.004010 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:17.003978 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-9wt8c_4a60e518-a9fc-4d46-a9b8-94985a7f557c/kube-auth-proxy/0.log" Jun 11 17:02:17.937202 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:17.937173 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g_4a850f5d-576b-4fd3-b469-505b211f17c4/storage-initializer/0.log" Jun 11 17:02:17.945216 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:17.945191 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-fkq9g_4a850f5d-576b-4fd3-b469-505b211f17c4/main/0.log" Jun 11 17:02:18.404154 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:18.404125 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-49v88_8b44247d-6dd8-4494-9386-e3caebeb69ec/storage-initializer/0.log" Jun 11 17:02:18.410999 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:18.410979 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-49v88_8b44247d-6dd8-4494-9386-e3caebeb69ec/main/0.log" Jun 11 17:02:18.519844 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:18.519793 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-rvjr4_30bd6979-f2ae-44fa-99d0-0309661dfab1/storage-initializer/0.log" Jun 11 17:02:18.527718 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:18.527699 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-rvjr4_30bd6979-f2ae-44fa-99d0-0309661dfab1/main/0.log" Jun 11 17:02:22.618470 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.618435 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gd56l/must-gather-8bggb"] Jun 11 17:02:22.618960 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.618830 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292606fb-e91a-481b-9c7c-c012978a7305" containerName="authorino" Jun 11 17:02:22.618960 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.618842 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="292606fb-e91a-481b-9c7c-c012978a7305" containerName="authorino" Jun 11 17:02:22.618960 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.618924 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="292606fb-e91a-481b-9c7c-c012978a7305" containerName="authorino" Jun 11 17:02:22.622099 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.622081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.628246 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.628195 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gd56l\"/\"default-dockercfg-68j4x\"" Jun 11 17:02:22.629197 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.628876 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd56l\"/\"openshift-service-ca.crt\"" Jun 11 17:02:22.629724 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.629705 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd56l\"/\"kube-root-ca.crt\"" Jun 11 17:02:22.638136 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.638111 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/must-gather-8bggb"] Jun 11 17:02:22.742414 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.742337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxw5\" (UniqueName: \"kubernetes.io/projected/16d5180c-bf1d-4327-82fb-7271a0fb37bd-kube-api-access-mbxw5\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.742613 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.742443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/16d5180c-bf1d-4327-82fb-7271a0fb37bd-must-gather-output\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.844039 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.843997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxw5\" (UniqueName: \"kubernetes.io/projected/16d5180c-bf1d-4327-82fb-7271a0fb37bd-kube-api-access-mbxw5\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.844039 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.844045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/16d5180c-bf1d-4327-82fb-7271a0fb37bd-must-gather-output\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.844393 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.844375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/16d5180c-bf1d-4327-82fb-7271a0fb37bd-must-gather-output\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.852535 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.852505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxw5\" (UniqueName: \"kubernetes.io/projected/16d5180c-bf1d-4327-82fb-7271a0fb37bd-kube-api-access-mbxw5\") pod \"must-gather-8bggb\" (UID: \"16d5180c-bf1d-4327-82fb-7271a0fb37bd\") " pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:22.931742 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:22.931701 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/must-gather-8bggb" Jun 11 17:02:23.067592 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:23.067567 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/must-gather-8bggb"] Jun 11 17:02:23.069655 ip-10-0-142-49 kubenswrapper[2557]: W0611 17:02:23.069621 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16d5180c_bf1d_4327_82fb_7271a0fb37bd.slice/crio-c46634a27f9325908679c7d35cbc93a96972ef14e5905165892a1438e7a4f811 WatchSource:0}: Error finding container c46634a27f9325908679c7d35cbc93a96972ef14e5905165892a1438e7a4f811: Status 404 returned error can't find the container with id c46634a27f9325908679c7d35cbc93a96972ef14e5905165892a1438e7a4f811 Jun 11 17:02:23.071600 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:23.071579 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:02:23.636998 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:23.636955 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/must-gather-8bggb" event={"ID":"16d5180c-bf1d-4327-82fb-7271a0fb37bd","Type":"ContainerStarted","Data":"c46634a27f9325908679c7d35cbc93a96972ef14e5905165892a1438e7a4f811"} Jun 11 17:02:24.647466 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:24.647422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/must-gather-8bggb" event={"ID":"16d5180c-bf1d-4327-82fb-7271a0fb37bd","Type":"ContainerStarted","Data":"22b5d01f266eb8c51219879dbde3b373c975f12ec2c59069f38d5eebf8597c89"} Jun 11 17:02:24.647966 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:24.647479 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/must-gather-8bggb" event={"ID":"16d5180c-bf1d-4327-82fb-7271a0fb37bd","Type":"ContainerStarted","Data":"3b767ea7aeed6a872af83b053cb2b5673278f93a42a7b88b37505a974b593797"} Jun 11 17:02:25.815126 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:25.815091 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-crrdf_caf2e313-c9de-42f7-901b-cc83af612fa8/global-pull-secret-syncer/0.log" Jun 11 17:02:25.936853 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:25.936815 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nvz7x_cd07688a-2e63-4bc2-b93a-a576607255bc/konnectivity-agent/0.log" Jun 11 17:02:26.157230 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:26.157194 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-49.ec2.internal_793eafcf8812d9f307dfb0f2621e1603/haproxy/0.log" Jun 11 17:02:30.780470 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:30.780432 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nqdhj_a03fb5e2-c47c-48e0-bcd4-76448345f105/manager/0.log" Jun 11 17:02:31.020361 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:31.020332 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lpcmj_f1e7370e-ebe5-475a-b465-38d8158dcb84/limitador/0.log" Jun 11 17:02:32.742200 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.742144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/alertmanager/0.log" Jun 11 17:02:32.768086 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.768054 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/config-reloader/0.log" Jun 11 17:02:32.791860 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.791830 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/kube-rbac-proxy-web/0.log" Jun 11 17:02:32.816274 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.816233 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/kube-rbac-proxy/0.log" Jun 11 17:02:32.840740 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.840708 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/kube-rbac-proxy-metric/0.log" Jun 11 17:02:32.864452 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.864419 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/prom-label-proxy/0.log" Jun 11 17:02:32.886551 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:32.886468 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0abc25ed-b6fa-45ae-880e-ba71026f85e6/init-config-reloader/0.log" Jun 11 17:02:33.052750 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.052717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vwfbp_d6258a7d-eeb3-4b4d-900e-4a7fbd1b682c/monitoring-plugin/0.log" Jun 11 17:02:33.180062 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.179985 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5b9c9_9af92041-00b2-4e8a-89dc-54e07fe6c513/node-exporter/0.log" Jun 11 17:02:33.202343 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.202282 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5b9c9_9af92041-00b2-4e8a-89dc-54e07fe6c513/kube-rbac-proxy/0.log" Jun 11 17:02:33.225355 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.225325 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5b9c9_9af92041-00b2-4e8a-89dc-54e07fe6c513/init-textfile/0.log" Jun 11 17:02:33.416468 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.416437 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/prometheus/0.log" Jun 11 17:02:33.444727 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.444618 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/config-reloader/0.log" Jun 11 17:02:33.471042 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.470951 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/thanos-sidecar/0.log" Jun 11 17:02:33.495763 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.495738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/kube-rbac-proxy-web/0.log" Jun 11 17:02:33.525160 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.525112 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/kube-rbac-proxy/0.log" Jun 11 17:02:33.553021 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.552993 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/kube-rbac-proxy-thanos/0.log" Jun 11 17:02:33.579607 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.579580 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600de235-fce2-4e01-bdc7-3980c3309798/init-config-reloader/0.log" Jun 11 17:02:33.620633 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.620603 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gwgsr_8ca9e3a4-9c9a-4472-a92e-6bcc88b82685/prometheus-operator/0.log" Jun 11 17:02:33.644721 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.644683 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gwgsr_8ca9e3a4-9c9a-4472-a92e-6bcc88b82685/kube-rbac-proxy/0.log" Jun 11 17:02:33.673477 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.673417 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-vbpd5_f4bb09e1-c058-4f35-aeb9-2ac003d57b9e/prometheus-operator-admission-webhook/0.log" Jun 11 17:02:33.809523 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.809411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/thanos-query/0.log" Jun 11 17:02:33.832533 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.832488 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/kube-rbac-proxy-web/0.log" Jun 11 17:02:33.858516 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.858479 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/kube-rbac-proxy/0.log" Jun 11 17:02:33.882546 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.882511 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/prom-label-proxy/0.log" Jun 11 17:02:33.908435 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.908356 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/kube-rbac-proxy-rules/0.log" Jun 11 17:02:33.937147 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:33.937101 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-654467b86-jnktm_5345b03f-b87b-429d-84db-4917e2269ac2/kube-rbac-proxy-metrics/0.log" Jun 11 17:02:35.548111 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:35.548065 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-pxqpf_5a82a42d-7e03-4fc8-8c2a-90a8f5b1d2be/networking-console-plugin/0.log" Jun 11 17:02:36.857402 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:36.857360 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-tc4wt_af9da2f1-d162-4f6c-b586-e9a4594fbb95/download-server/0.log" Jun 11 17:02:37.256655 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.256591 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gd56l/must-gather-8bggb" podStartSLOduration=14.487394883 podStartE2EDuration="15.256569674s" totalImagesPullingTime="769.174791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:02:24.666134241 +0000 UTC m=+2588.553739389" watchObservedRunningTime="2026-06-11 17:02:37.256569674 +0000 UTC m=+2601.144174822" Jun 11 17:02:37.256875 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.256763 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf"] Jun 11 17:02:37.262021 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.261993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.272510 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.272479 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf"] Jun 11 17:02:37.399137 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.399099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-podres\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.399313 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.399145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-sys\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.399313 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.399192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-proc\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.399313 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.399297 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-lib-modules\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.399440 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.399329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr77c\" (UniqueName: \"kubernetes.io/projected/a2d44a36-92df-40e5-8602-21f0fd9e9b91-kube-api-access-rr77c\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.500349 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-podres\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.500608 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-sys\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.500765 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-proc\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.500944 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-lib-modules\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.501054 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.501035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr77c\" (UniqueName: \"kubernetes.io/projected/a2d44a36-92df-40e5-8602-21f0fd9e9b91-kube-api-access-rr77c\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.501573 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500623 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-podres\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.501720 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.500688 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-sys\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.501891 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.501871 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-proc\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.501982 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.501872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d44a36-92df-40e5-8602-21f0fd9e9b91-lib-modules\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.510535 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.510473 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr77c\" (UniqueName: \"kubernetes.io/projected/a2d44a36-92df-40e5-8602-21f0fd9e9b91-kube-api-access-rr77c\") pod \"perf-node-gather-daemonset-9rcmf\" (UID: \"a2d44a36-92df-40e5-8602-21f0fd9e9b91\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.580718 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.580679 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:37.589710 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.589663 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-ffbdr_4e5c0c70-eb89-4c7d-9011-14e2535c2898/volume-data-source-validator/0.log" Jun 11 17:02:37.780173 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:37.780141 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf"] Jun 11 17:02:38.758931 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.758889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" event={"ID":"a2d44a36-92df-40e5-8602-21f0fd9e9b91","Type":"ContainerStarted","Data":"3cb89f293d56d60f802d0a54ee8ba32b71fd096c29cccc2aec81d6151d334789"} Jun 11 17:02:38.759398 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.758954 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" event={"ID":"a2d44a36-92df-40e5-8602-21f0fd9e9b91","Type":"ContainerStarted","Data":"bdf3bbc0b601a5f686bf45a7ca7deb4a3bea0df627aab3d62f88bedfcfc9543f"} Jun 11 17:02:38.759398 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.758982 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:38.776539 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.776485 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" podStartSLOduration=1.7764683909999999 podStartE2EDuration="1.776468391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:02:38.774394185 +0000 UTC m=+2602.661999332" watchObservedRunningTime="2026-06-11 17:02:38.776468391 +0000 UTC m=+2602.664073537" Jun 11 17:02:38.854381 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.854347 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9rpw_aad08e4e-4cfe-4420-a071-6210f76d154c/dns/0.log" Jun 11 17:02:38.875816 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.875765 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9rpw_aad08e4e-4cfe-4420-a071-6210f76d154c/kube-rbac-proxy/0.log" Jun 11 17:02:38.931327 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:38.931295 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mbjn4_e6993041-e8d6-416f-b702-fdd8adc34b9e/dns-node-resolver/0.log" Jun 11 17:02:39.644161 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:39.644124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-99fkl_5374ba43-7006-45fe-a566-301bd90a57e0/node-ca/0.log" Jun 11 17:02:40.771861 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:40.771828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-9wt8c_4a60e518-a9fc-4d46-a9b8-94985a7f557c/kube-auth-proxy/0.log" Jun 11 17:02:41.616813 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:41.616773 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29b7p_2aaa2106-93ab-4ae7-9f3e-78d493c63f20/serve-healthcheck-canary/0.log" Jun 11 17:02:42.381378 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:42.381350 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2j98_26b20ee4-7d53-453d-b606-80d96ca2c9e7/kube-rbac-proxy/0.log" Jun 11 17:02:42.409519 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:42.409492 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2j98_26b20ee4-7d53-453d-b606-80d96ca2c9e7/exporter/0.log" Jun 11 17:02:42.432398 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:42.432371 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2j98_26b20ee4-7d53-453d-b606-80d96ca2c9e7/extractor/0.log" Jun 11 17:02:44.776101 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:44.776069 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-9rcmf" Jun 11 17:02:45.228524 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:45.228497 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-kqnlm_250f6fa1-0ad5-4562-8a27-34bdd5360012/manager/0.log" Jun 11 17:02:45.251368 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:45.251335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-kqnlm_250f6fa1-0ad5-4562-8a27-34bdd5360012/copy-manifests/0.log" Jun 11 17:02:47.343251 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:47.343195 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f7f9c74f-9l6xf_248f9166-2b1a-4596-b622-47e4fcdbe621/manager/0.log" Jun 11 17:02:51.466583 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:51.466536 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-9wt8c_4a60e518-a9fc-4d46-a9b8-94985a7f557c/kube-auth-proxy/0.log" Jun 11 17:02:52.877188 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:52.877151 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-9wt8c_4a60e518-a9fc-4d46-a9b8-94985a7f557c/kube-auth-proxy/0.log" Jun 11 17:02:53.352907 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:53.352788 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zrfgw_df462b57-feae-48cc-958d-292f5d24466c/kube-storage-version-migrator-operator/1.log" Jun 11 17:02:53.353819 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:53.353774 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zrfgw_df462b57-feae-48cc-958d-292f5d24466c/kube-storage-version-migrator-operator/0.log" Jun 11 17:02:54.532115 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.532085 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9ktx7_d63814e7-bf6f-456e-bd50-36c7656687f3/kube-multus/0.log" Jun 11 17:02:54.787541 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.787445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-9wt8c_4a60e518-a9fc-4d46-a9b8-94985a7f557c/kube-auth-proxy/0.log" Jun 11 17:02:54.892165 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.892135 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/kube-multus-additional-cni-plugins/0.log" Jun 11 17:02:54.916640 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.916614 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/egress-router-binary-copy/0.log" Jun 11 17:02:54.939310 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.939202 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/cni-plugins/0.log" Jun 11 17:02:54.992719 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:54.992686 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/bond-cni-plugin/0.log" Jun 11 17:02:55.016813 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:55.016755 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/routeoverride-cni/0.log" Jun 11 17:02:55.039165 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:55.039077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/whereabouts-cni-bincopy/0.log" Jun 11 17:02:55.062917 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:55.062887 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwhdk_3a2f847a-eae6-4648-b8bd-cdb3e0274c3c/whereabouts-cni/0.log" Jun 11 17:02:55.201526 ip-10-0-142-49 kubenswrapper[2557]: I0611 17:02:55.201497 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hc4dt_82a4dcc6-86f8-4a17-b32b-6166ff650641/network-metrics-daemon/0.log"