Jun 11 13:25:55.087081 ip-10-0-141-110 systemd[1]: Starting Kubernetes Kubelet... Jun 11 13:25:55.483081 ip-10-0-141-110 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:25:55.483081 ip-10-0-141-110 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 13:25:55.483081 ip-10-0-141-110 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:25:55.483081 ip-10-0-141-110 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 13:25:55.483081 ip-10-0-141-110 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:25:55.484235 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.484146 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 13:25:55.488592 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488571 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.488592 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488590 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.488592 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488595 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488599 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488602 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488605 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488608 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488611 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488613 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488616 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488619 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488621 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488624 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488627 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488630 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488638 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488640 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488643 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488646 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488648 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488651 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488653 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.488705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488656 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488659 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488662 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488664 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488666 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488669 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488672 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488675 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488677 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488680 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488682 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488685 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488688 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488691 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488694 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488697 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488700 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488702 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488706 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488709 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.489197 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488711 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488714 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488716 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488719 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488722 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488725 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488743 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488746 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488749 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488751 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488754 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488757 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488759 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488762 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488764 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488769 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488772 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488776 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488779 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.489675 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488782 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488784 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488788 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488790 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488793 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488796 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488799 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488803 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488807 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488809 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488812 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488815 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488817 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488819 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488822 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488825 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488828 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488831 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488833 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488839 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.490164 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488842 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488845 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488847 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488851 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488855 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488857 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488860 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488862 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488865 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488868 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488870 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488873 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488875 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488878 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488880 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488883 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488885 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.488888 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489590 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.490642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489598 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489601 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489604 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489607 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489609 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489612 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489614 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489619 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489623 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489626 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489629 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489634 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489637 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489641 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489644 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489647 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489650 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489653 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489657 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.491154 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489660 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489663 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489665 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489668 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489671 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489673 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489676 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489679 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489682 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489685 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489687 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489690 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489693 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489696 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489699 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489702 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489704 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489707 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489709 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.491628 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489712 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489714 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489717 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489719 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489722 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489745 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489748 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489750 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489754 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489757 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489760 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489762 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489765 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489768 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489770 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489772 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489775 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489777 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489780 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489783 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.492112 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489786 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489790 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489793 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489796 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489798 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489801 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489804 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489807 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489809 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489812 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489814 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489817 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489819 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489822 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489824 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489827 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489829 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489832 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489834 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489837 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.492608 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489840 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489843 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489845 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489848 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489850 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489853 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489855 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489858 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489860 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489863 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489865 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489868 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489870 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489873 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489876 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489878 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489881 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489883 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489889 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.489891 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.493111 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490329 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490335 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490339 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490342 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490345 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490348 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490351 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490353 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490356 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490359 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490361 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490364 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490367 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490370 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490372 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490376 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490379 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490381 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490384 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490386 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.493600 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490389 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490391 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490394 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490396 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490399 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490401 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490404 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490406 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490409 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490411 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490416 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490419 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490422 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490425 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490427 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490430 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490432 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490435 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490437 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490440 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.494117 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490442 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490446 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490450 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490453 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490456 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490459 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490462 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490465 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490468 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490470 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490473 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490477 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490480 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490483 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490486 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490489 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490492 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490494 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490497 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.494601 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490500 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490503 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490505 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490510 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490514 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490517 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490520 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490522 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490525 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490527 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490530 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490532 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490535 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490537 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490541 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490543 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490546 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490548 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490551 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.495085 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490553 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490557 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490560 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490562 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490565 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490567 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490570 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490572 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490575 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490578 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490580 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490583 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490586 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490588 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490591 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490593 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490597 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490599 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490602 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490604 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.495562 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.490607 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490688 2552 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490696 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490703 2552 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490707 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490712 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490715 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490719 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490724 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490740 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490744 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490747 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490751 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490754 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490758 2552 flags.go:64] FLAG: --cgroup-root="" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490761 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490763 2552 flags.go:64] FLAG: --client-ca-file="" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490766 2552 flags.go:64] FLAG: --cloud-provider="external" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490769 2552 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490774 2552 flags.go:64] FLAG: --cluster-domain="" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490778 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490781 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490784 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490787 2552 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 13:25:55.496101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490791 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490794 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490798 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490801 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490805 2552 flags.go:64] FLAG: --contention-profiling="false" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490808 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490811 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490815 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490818 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490822 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490825 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490828 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490831 2552 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490834 2552 flags.go:64] FLAG: --enable-server="true" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490837 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490841 2552 flags.go:64] FLAG: --event-burst="100" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490844 2552 flags.go:64] FLAG: --event-qps="50" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490847 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490850 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490855 2552 flags.go:64] FLAG: --eviction-hard="" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490859 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490862 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490865 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490868 2552 flags.go:64] FLAG: --eviction-soft="" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490871 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 13:25:55.496681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490874 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490877 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490879 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490882 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490885 2552 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490888 2552 flags.go:64] FLAG: --feature-gates="" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490892 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490895 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490898 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490901 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490904 2552 flags.go:64] FLAG: --healthz-port="10248" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490907 2552 flags.go:64] FLAG: --help="false" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490910 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490913 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490916 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490919 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490923 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490926 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490929 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490932 2552 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490935 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490937 2552 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490940 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490943 2552 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 13:25:55.497337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490946 2552 flags.go:64] FLAG: --kube-reserved="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490949 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490953 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490956 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490959 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490962 2552 flags.go:64] FLAG: --lock-file="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490965 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490968 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490972 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490977 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490980 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490983 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490986 2552 flags.go:64] FLAG: --logging-format="text" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490989 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490993 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490995 2552 flags.go:64] FLAG: --manifest-url="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.490998 2552 flags.go:64] FLAG: --manifest-url-header="" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491003 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491006 2552 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491011 2552 flags.go:64] FLAG: --max-pods="110" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491014 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491017 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491020 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491023 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491026 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 13:25:55.497952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491029 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491032 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491039 2552 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491042 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491045 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491048 2552 flags.go:64] FLAG: --pod-cidr="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491051 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491056 2552 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491059 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491063 2552 flags.go:64] FLAG: --pods-per-core="0" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491066 2552 flags.go:64] FLAG: --port="10250" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491069 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491072 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0664fe1c068769dfd" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491075 2552 flags.go:64] FLAG: --qos-reserved="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491078 2552 flags.go:64] FLAG: --read-only-port="10255" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491082 2552 flags.go:64] FLAG: --register-node="true" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491085 2552 flags.go:64] FLAG: --register-with-taints="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491089 2552 flags.go:64] FLAG: --registry-burst="10" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491091 2552 flags.go:64] FLAG: --registry-qps="5" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491094 2552 flags.go:64] FLAG: --reserved-cpus="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491098 2552 flags.go:64] FLAG: --reserved-memory="" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491101 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491105 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491107 2552 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491110 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 13:25:55.498585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491113 2552 flags.go:64] FLAG: --runonce="false" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491116 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491119 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491122 2552 flags.go:64] FLAG: --seccomp-default="false" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491125 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491127 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491131 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491134 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491137 2552 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491140 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491143 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491146 2552 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491148 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491151 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491154 2552 flags.go:64] FLAG: --system-cgroups="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491157 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491164 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491167 2552 flags.go:64] FLAG: --tls-cert-file="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491170 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491175 2552 flags.go:64] FLAG: --tls-min-version="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491178 2552 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491181 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491184 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491187 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491190 2552 flags.go:64] FLAG: --v="2" Jun 11 13:25:55.499340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491195 2552 flags.go:64] FLAG: --version="false" Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491200 2552 flags.go:64] FLAG: --vmodule="" Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491204 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.491208 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491322 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491325 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491328 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491331 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491334 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491336 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491339 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491342 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491344 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491347 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491351 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491354 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491357 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491360 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491363 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491366 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.500306 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491368 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491371 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491373 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491377 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491380 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491384 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491388 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491391 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491394 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491396 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491399 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491403 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491406 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491410 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491413 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491415 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491418 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491421 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491424 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491426 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.500857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491429 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491431 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491434 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491437 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491439 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491442 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491444 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491447 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491450 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491453 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491455 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491458 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491461 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491463 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491466 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491470 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491473 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491476 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491478 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491481 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.501357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491483 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491486 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491489 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491491 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491494 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491498 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491501 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491503 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491506 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491509 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491511 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491514 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491516 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491519 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491522 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491524 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491527 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491529 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491532 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491534 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.501867 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491537 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491539 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491542 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491545 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491547 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491550 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491552 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491557 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491560 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491562 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491565 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491568 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491570 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491572 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491575 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491579 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491582 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491587 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491590 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491593 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.502360 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491596 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491599 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.491601 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.492349 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.501444 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.501462 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.501483 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.501488 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501548 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501568 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501573 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501576 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501579 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501581 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501584 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.502866 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501587 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501589 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501592 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501595 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501598 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501601 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501604 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501607 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501610 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501614 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501617 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501620 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501625 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501629 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501632 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501636 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501639 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501642 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501645 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501648 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.503273 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501651 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501654 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501656 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501659 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501662 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501664 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501667 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501671 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501675 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501677 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501680 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501683 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501685 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501688 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501691 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501693 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501696 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501699 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501702 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.503770 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501704 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501707 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501710 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501713 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501716 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501718 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501742 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501747 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501750 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501753 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501757 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501760 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501762 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501765 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501767 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501770 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501773 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501776 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501778 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.504236 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501781 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501784 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501786 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501789 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501792 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501795 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501798 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501800 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501803 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501805 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501808 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501811 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501814 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501816 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501820 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501823 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501825 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501828 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501830 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501833 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.504749 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501835 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501838 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501841 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501843 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501846 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501848 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501851 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501853 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501856 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501859 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501861 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501864 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501867 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501870 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.501875 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:25:55.505231 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.501995 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502000 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502004 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502006 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502009 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502011 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502014 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502017 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502020 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502023 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502025 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502028 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502031 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502034 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502036 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502039 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502042 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502044 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502047 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502050 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:25:55.505610 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502053 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502056 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502060 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502063 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502066 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502069 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502076 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502079 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502082 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502084 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502087 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502089 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502092 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502095 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502098 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502100 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502103 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502105 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502110 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:25:55.506256 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502113 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502116 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502119 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502122 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502125 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502128 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502132 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502134 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502137 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502140 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502143 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502145 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502148 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502152 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502154 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502157 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502160 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502162 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502165 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502167 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:25:55.506714 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502170 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502173 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502175 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502178 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502180 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502183 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502185 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502188 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502190 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502193 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502196 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502199 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502203 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502206 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502208 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502211 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502213 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502216 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502218 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:25:55.507220 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502222 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502225 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502227 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502229 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502232 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502235 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502237 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502240 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502245 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502248 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502250 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502252 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502255 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502258 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502260 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502263 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502265 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502268 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502271 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502273 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:25:55.507679 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:55.502276 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.502281 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.502400 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.505298 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.506485 2552 server.go:1019] "Starting client certificate rotation" Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.506593 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:25:55.508176 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.506632 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:25:55.509045 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.509030 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:25:55.512540 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.512516 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:25:55.522486 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.522467 2552 log.go:25] "Validated CRI v1 runtime API" Jun 11 13:25:55.526354 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.526332 2552 log.go:25] "Validated CRI v1 image API" Jun 11 13:25:55.527215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.527196 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 13:25:55.530426 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.530404 2552 fs.go:135] Filesystem UUIDs: map[2ae959e5-d923-4734-bd10-339518f75f61:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ec4bc47d-2ea2-4b88-9f5c-fc1a8c4b2410:/dev/nvme0n1p3] Jun 11 13:25:55.530494 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.530423 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 13:25:55.537814 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.537675 2552 manager.go:216] Machine: {Timestamp:2026-06-11 13:25:55.536343633 +0000 UTC m=+0.334678693 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094076 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2717c9ed5f15d564a5085b850cd085 SystemUUID:ec2717c9-ed5f-15d5-64a5-085b850cd085 BootID:7b5fd233-6c28-4ade-9ad8-ccc28f12dc82 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:22:e9:b0:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:22:e9:b0:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:01:0e:5f:36:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 13:25:55.537814 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.537800 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 13:25:55.537960 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.537891 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 13:25:55.538272 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.538256 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:25:55.540991 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.540963 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 13:25:55.541130 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.540994 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 13:25:55.542281 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.542269 2552 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 13:25:55.542327 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.542284 2552 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 13:25:55.542327 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.542292 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:25:55.542959 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.542948 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:25:55.543747 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.543723 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 13:25:55.546618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546604 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:25:55.546742 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546719 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 13:25:55.546775 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546767 2552 kubelet.go:486] "Attempting to sync node with API server" Jun 11 13:25:55.546809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546777 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 13:25:55.546809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546790 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 13:25:55.546809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546801 2552 kubelet.go:398] "Adding apiserver pod source" Jun 11 13:25:55.546912 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.546811 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 13:25:55.547183 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.547169 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:25:55.547243 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.547192 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:25:55.549628 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.549612 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 13:25:55.551814 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.551801 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 13:25:55.551870 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.551831 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 13:25:55.553036 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553024 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553040 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553046 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553052 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553061 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553067 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553077 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553083 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 13:25:55.553086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553090 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 13:25:55.553291 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553096 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 13:25:55.553291 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553104 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 13:25:55.553291 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553110 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 13:25:55.553918 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553906 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 13:25:55.553918 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.553917 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 13:25:55.554041 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.554018 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 13:25:55.554092 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.554034 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 13:25:55.557143 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.557128 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 13:25:55.557225 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.557148 2552 server.go:1268] "Started kubelet" Jun 11 13:25:55.557279 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.557236 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 13:25:55.557279 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.557222 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 13:25:55.557369 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.557307 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 13:25:55.558066 ip-10-0-141-110 systemd[1]: Started Kubernetes Kubelet. Jun 11 13:25:55.558723 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.558654 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd6jz" Jun 11 13:25:55.559121 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.559033 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 13:25:55.559749 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.559720 2552 server.go:310] "Adding debug handlers to kubelet server" Jun 11 13:25:55.564629 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.564600 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 13:25:55.564727 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.563663 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-110.ec2.internal.18b809bbf8771ca4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-110.ec2.internal,UID:ip-10-0-141-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-110.ec2.internal,},FirstTimestamp:2026-06-11 13:25:55.557121188 +0000 UTC m=+0.355456249,LastTimestamp:2026-06-11 13:25:55.557121188 +0000 UTC m=+0.355456249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-110.ec2.internal,}" Jun 11 13:25:55.564834 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.564787 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd6jz" Jun 11 13:25:55.565810 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.565781 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 13:25:55.565810 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.565787 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 13:25:55.566265 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.566240 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:55.566926 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.566906 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 13:25:55.567215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.567200 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 13:25:55.567313 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.567303 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 13:25:55.567638 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.567623 2552 reconstruct.go:97] "Volume reconstruction finished" Jun 11 13:25:55.567638 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.567635 2552 reconciler.go:29] "Reconciler: start to sync state" Jun 11 13:25:55.568848 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.568583 2552 factory.go:55] Registering systemd factory Jun 11 13:25:55.568848 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.568616 2552 factory.go:223] Registration of the systemd container factory successfully Jun 11 13:25:55.569044 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.568982 2552 factory.go:153] Registering CRI-O factory Jun 11 13:25:55.569044 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.569002 2552 factory.go:223] Registration of the crio container factory successfully Jun 11 13:25:55.569044 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.569022 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 13:25:55.569178 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.569067 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 13:25:55.569178 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.569093 2552 factory.go:103] Registering Raw factory Jun 11 13:25:55.569178 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.569083 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 13:25:55.569178 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.569110 2552 manager.go:1196] Started watching for new ooms in manager Jun 11 13:25:55.569898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.569883 2552 manager.go:349] Starting recovery of all containers Jun 11 13:25:55.582259 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.582236 2552 manager.go:354] Recovery completed Jun 11 13:25:55.586548 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.586535 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.588383 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588363 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.588463 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588396 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.588463 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588419 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.588959 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588944 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 13:25:55.588959 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588956 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.589065 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.588956 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 13:25:55.589065 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.589035 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:25:55.590233 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590213 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.590322 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590252 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.590322 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590264 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.590322 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590313 2552 policy_none.go:49] "None policy: Start" Jun 11 13:25:55.590443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590330 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 13:25:55.590443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.590342 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 13:25:55.591284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.591268 2552 policy_none.go:47] "Start" Jun 11 13:25:55.624626 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.624358 2552 manager.go:337] "Starting Device Plugin manager" Jun 11 13:25:55.624626 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.624595 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 13:25:55.624626 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.624609 2552 server.go:87] "Starting device plugin registration server" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.624927 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.624940 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.625038 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.625170 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.625183 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.625953 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.626006 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.632142 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.633245 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.633290 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.633310 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 13:25:55.633571 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.633389 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 13:25:55.635243 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.635225 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:25:55.725475 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.725447 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.726582 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.726562 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.726680 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.726595 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.726680 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.726609 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.726680 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.726638 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.733848 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.733759 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.733848 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.733782 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-110.ec2.internal\": node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:55.733946 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.733863 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"] Jun 11 13:25:55.733946 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.733929 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.735539 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.735525 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.735596 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.735553 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.735596 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.735567 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.736936 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.736921 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.737053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737028 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.737093 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737057 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.737601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737586 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.737601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737597 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.737686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737615 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.737686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737615 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.737686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737635 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.737686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.737626 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.739029 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.739015 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.739094 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.739037 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:25:55.739658 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.739643 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:25:55.739751 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.739665 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:25:55.739751 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.739673 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:25:55.747988 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.747969 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:55.758253 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.758235 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-110.ec2.internal\" not found" node="ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.761540 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.761523 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-110.ec2.internal\" not found" node="ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.769002 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.768752 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f0da86fafeabede4d4debcf58e01a6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"67f0da86fafeabede4d4debcf58e01a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.769088 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.769023 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.769146 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.769083 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.848646 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.848614 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:55.869491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869458 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f0da86fafeabede4d4debcf58e01a6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"67f0da86fafeabede4d4debcf58e01a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.869491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.869686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869507 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.869686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869545 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.869686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869567 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f0da86fafeabede4d4debcf58e01a6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"67f0da86fafeabede4d4debcf58e01a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.869686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:55.869574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/012fe33fc29e15bcc8a12cd15f2aaf64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"012fe33fc29e15bcc8a12cd15f2aaf64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:55.949342 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:55.949302 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.050195 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.050099 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.062269 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.062247 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:56.067180 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.066589 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:56.150473 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.150439 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.251038 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.250995 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.351533 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.351457 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.452247 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.452211 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found" Jun 11 13:25:56.505617 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.505587 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 13:25:56.506221 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.505771 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 13:25:56.531876 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.531853 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:25:56.547442 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.547419 2552 apiserver.go:52] "Watching apiserver" Jun 11 13:25:56.558010 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.557984 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 13:25:56.559017 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.558996 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-hsvkx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv","openshift-image-registry/node-ca-rbjrd","openshift-multus/multus-additional-cni-plugins-d2wj7","openshift-multus/multus-v6dth","openshift-multus/network-metrics-daemon-5d9lx","openshift-network-diagnostics/network-check-target-95sfl","openshift-network-operator/iptables-alerter-27hxz","kube-system/global-pull-secret-syncer-rsrkm","openshift-cluster-node-tuning-operator/tuned-hlkbz","openshift-dns/node-resolver-k8ptl","openshift-ovn-kubernetes/ovnkube-node-82kl4"] Jun 11 13:25:56.560502 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.560482 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.561703 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.561675 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.562423 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.562407 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 13:25:56.562510 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.562459 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5dkcq\"" Jun 11 13:25:56.562666 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.562650 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 13:25:56.562892 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.562872 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.563445 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.563427 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4ks5f\"" Jun 11 13:25:56.563722 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.563704 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.563813 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.563741 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 13:25:56.563813 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.563801 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.564126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.564108 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.564594 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.564575 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.565037 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.564997 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.565037 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.565011 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rvm85\"" Jun 11 13:25:56.565161 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.565054 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 13:25:56.565295 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.565275 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.566024 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566005 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 13:25:56.566126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566062 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qgfxj\"" Jun 11 13:25:56.566126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566094 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 13:25:56.566126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566097 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 13:25:56.566126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566117 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 13:25:56.566315 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566190 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.566460 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566440 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.566565 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566474 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" Jun 11 13:25:56.566632 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.566564 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.566676 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.566632 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:25:56.567102 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.567084 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 13:25:56.567193 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.567108 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b8tcz\"" Jun 11 13:25:56.568757 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.568523 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 13:20:55 +0000 UTC" deadline="2028-02-29 17:18:21.155828408 +0000 UTC" Jun 11 13:25:56.568757 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.568569 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15075h52m24.587263061s" Jun 11 13:25:56.570166 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.570144 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:56.570257 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.570219 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:25:56.571787 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.571770 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.573169 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-os-release\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573246 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573183 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-etc-kubernetes\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573246 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573188 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.573246 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-device-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cnibin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.573286 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrfnr\" (UniqueName: \"kubernetes.io/projected/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-kube-api-access-nrfnr\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573332 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-socket-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.573428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573407 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-etc-selinux\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/603a79c1-ffea-470f-a6a6-e371e95c912b-host\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573453 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-os-release\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573493 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-socket-dir-parent\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573526 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-k8s-cni-cncf-io\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573546 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-bin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573571 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef73d619-8584-479c-8450-74f1289e09c3-konnectivity-ca\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/603a79c1-ffea-470f-a6a6-e371e95c912b-serviceca\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573595 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573640 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573648 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pf66x\"" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldh4g\" (UniqueName: \"kubernetes.io/projected/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-kube-api-access-ldh4g\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573698 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.573725 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573713 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-kubelet\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573765 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-multus-certs\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6zt\" (UniqueName: \"kubernetes.io/projected/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kube-api-access-cq6zt\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573838 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-hostroot\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573862 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-conf-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573894 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-registration-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573917 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573915 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-sys-fs\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzk5\" (UniqueName: \"kubernetes.io/projected/603a79c1-ffea-470f-a6a6-e371e95c912b-kube-api-access-xhzk5\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.573987 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-system-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cni-binary-copy\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-netns\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574074 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef73d619-8584-479c-8450-74f1289e09c3-agent-certs\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-system-cni-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.574318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574161 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmq6f\" (UniqueName: \"kubernetes.io/projected/5cca170b-7a55-45a9-a701-a64f70a691cf-kube-api-access-tmq6f\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.575008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574191 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-multus\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.575008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-daemon-config\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.575008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574231 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-cnibin\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.575008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574251 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.575008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.574494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.575851 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.575835 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.576478 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.576456 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:25:56.576553 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.576505 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.576553 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.576538 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" Jun 11 13:25:56.576648 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.576566 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-blld5\"" Jun 11 13:25:56.576702 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.576682 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.577545 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.577527 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.577617 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.577543 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tt2zt\"" Jun 11 13:25:56.577670 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.577660 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.577834 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.577816 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"] Jun 11 13:25:56.577907 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.577896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.579869 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.579849 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j8tm5\"" Jun 11 13:25:56.579966 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.579873 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 13:25:56.580398 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.580137 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 13:25:56.580398 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.580138 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 13:25:56.580523 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.580346 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 13:25:56.580576 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.580568 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 13:25:56.580883 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.580869 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 13:25:56.581888 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.581870 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:25:56.585271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.585251 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:25:56.585395 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.585383 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"] Jun 11 13:25:56.603006 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.602988 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-87ms9" Jun 11 13:25:56.610657 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.610634 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-87ms9" Jun 11 13:25:56.619705 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.619664 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012fe33fc29e15bcc8a12cd15f2aaf64.slice/crio-fb1be37ea4a07ec5058ac4e98ce2017051a2b37daa712f183aa6f35aa8045e57 WatchSource:0}: Error finding container fb1be37ea4a07ec5058ac4e98ce2017051a2b37daa712f183aa6f35aa8045e57: Status 404 returned error can't find the container with id fb1be37ea4a07ec5058ac4e98ce2017051a2b37daa712f183aa6f35aa8045e57 Jun 11 13:25:56.620121 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.620102 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f0da86fafeabede4d4debcf58e01a6.slice/crio-befc354ccd2151e4c5bdfb06f1963fa8ce0615142cf0525924202269d4b35d81 WatchSource:0}: Error finding container befc354ccd2151e4c5bdfb06f1963fa8ce0615142cf0525924202269d4b35d81: Status 404 returned error can't find the container with id befc354ccd2151e4c5bdfb06f1963fa8ce0615142cf0525924202269d4b35d81 Jun 11 13:25:56.624711 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.624692 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:25:56.636416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.636368 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" event={"ID":"67f0da86fafeabede4d4debcf58e01a6","Type":"ContainerStarted","Data":"befc354ccd2151e4c5bdfb06f1963fa8ce0615142cf0525924202269d4b35d81"} Jun 11 13:25:56.637713 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.637667 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"012fe33fc29e15bcc8a12cd15f2aaf64","Type":"ContainerStarted","Data":"fb1be37ea4a07ec5058ac4e98ce2017051a2b37daa712f183aa6f35aa8045e57"} Jun 11 13:25:56.667960 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.667937 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 13:25:56.675019 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-etc-kubernetes\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675030 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-conf\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.675101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-var-lib-kubelet\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.675101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675068 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.675101 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-etc-selinux\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-etc-kubernetes\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-os-release\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675151 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-etc-selinux\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-socket-dir-parent\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-k8s-cni-cncf-io\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675152 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675197 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-os-release\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-socket-dir-parent\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675244 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-k8s-cni-cncf-io\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675271 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675256 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675285 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-kubelet\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675296 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-multus-certs\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675324 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-kubelet\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675339 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-systemd\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675346 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-multus-certs\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675353 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675370 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zlx9\" (UniqueName: \"kubernetes.io/projected/8073a57e-76f8-4cf5-b97f-361ee184ba8b-kube-api-access-5zlx9\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-kubelet-config\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6zt\" (UniqueName: \"kubernetes.io/projected/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kube-api-access-cq6zt\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-hostroot\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-conf-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675533 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-conf-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675554 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-run\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-hostroot\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc99h\" (UniqueName: \"kubernetes.io/projected/81611daa-28c5-4559-9b25-303c82f4e611-kube-api-access-lc99h\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.675852 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-ovn\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675695 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-bin\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzk5\" (UniqueName: \"kubernetes.io/projected/603a79c1-ffea-470f-a6a6-e371e95c912b-kube-api-access-xhzk5\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675783 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-system-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cni-binary-copy\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675858 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-netns\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-daemon-config\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-modprobe-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675929 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-system-cni-dir\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-kubernetes\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675946 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-run-netns\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.675964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676009 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef73d619-8584-479c-8450-74f1289e09c3-agent-certs\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.676035 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676078 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-system-cni-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.676581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676036 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-system-cni-dir\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.676102 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:25:57.176071362 +0000 UTC m=+1.974406435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmq6f\" (UniqueName: \"kubernetes.io/projected/5cca170b-7a55-45a9-a701-a64f70a691cf-kube-api-access-tmq6f\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676154 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-lib-modules\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxc5\" (UniqueName: \"kubernetes.io/projected/4a2c218c-6182-41b8-9594-b025d0106ea7-kube-api-access-llxc5\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676190 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-node-log\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676221 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-log-socket\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-kubelet\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-dbus\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-config\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cadb7eb2-3604-4782-a39f-b71d6487721d-ovn-node-metrics-cert\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676328 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysconfig\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676353 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cni-binary-copy\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-host\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676406 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-multus-daemon-config\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676415 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-slash\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.677418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-netd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-tuned\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676541 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-socket-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676534 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676571 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/603a79c1-ffea-470f-a6a6-e371e95c912b-host\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676608 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/603a79c1-ffea-470f-a6a6-e371e95c912b-host\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676640 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-socket-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676646 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-bin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-bin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a2c218c-6182-41b8-9594-b025d0106ea7-tmp-dir\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676692 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-netns\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-env-overrides\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t6rb\" (UniqueName: \"kubernetes.io/projected/cadb7eb2-3604-4782-a39f-b71d6487721d-kube-api-access-6t6rb\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676755 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef73d619-8584-479c-8450-74f1289e09c3-konnectivity-ca\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/603a79c1-ffea-470f-a6a6-e371e95c912b-serviceca\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldh4g\" (UniqueName: \"kubernetes.io/projected/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-kube-api-access-ldh4g\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.678034 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676813 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a2c218c-6182-41b8-9594-b025d0106ea7-hosts-file\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676834 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-script-lib\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-registration-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676914 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-registration-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-sys-fs\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676965 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-sys-fs\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.676996 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-multus\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677023 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677029 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-host-var-lib-cni-multus\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677055 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-sys\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677076 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81611daa-28c5-4559-9b25-303c82f4e611-host-slash\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-systemd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-cnibin\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677172 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81611daa-28c5-4559-9b25-303c82f4e611-iptables-alerter-script\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.678492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677202 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/603a79c1-ffea-470f-a6a6-e371e95c912b-serviceca\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677224 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-etc-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cca170b-7a55-45a9-a701-a64f70a691cf-cnibin\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef73d619-8584-479c-8450-74f1289e09c3-konnectivity-ca\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677349 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-os-release\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-tmp\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677382 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-systemd-units\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-device-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-os-release\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677447 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cnibin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677478 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfnr\" (UniqueName: \"kubernetes.io/projected/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-kube-api-access-nrfnr\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677507 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-var-lib-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677510 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-device-dir\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677592 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-cnibin\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677634 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.678976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.677695 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5cca170b-7a55-45a9-a701-a64f70a691cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.679717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.679700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef73d619-8584-479c-8450-74f1289e09c3-agent-certs\") pod \"konnectivity-agent-hsvkx\" (UID: \"ef73d619-8584-479c-8450-74f1289e09c3\") " pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.683416 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.683393 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:25:56.683416 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.683418 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:25:56.683572 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.683432 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:56.683572 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.683530 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:25:57.183485813 +0000 UTC m=+1.981820878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:56.684341 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.684318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6zt\" (UniqueName: \"kubernetes.io/projected/56ec9c4b-40b9-41f3-8d17-8eeeb2436260-kube-api-access-cq6zt\") pod \"aws-ebs-csi-driver-node-99bfv\" (UID: \"56ec9c4b-40b9-41f3-8d17-8eeeb2436260\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.684964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.684934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfnr\" (UniqueName: \"kubernetes.io/projected/4b6d88ca-1fdd-4c64-ab0d-68298eac9d29-kube-api-access-nrfnr\") pod \"multus-v6dth\" (UID: \"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29\") " pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.685324 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.685305 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmq6f\" (UniqueName: \"kubernetes.io/projected/5cca170b-7a55-45a9-a701-a64f70a691cf-kube-api-access-tmq6f\") pod \"multus-additional-cni-plugins-d2wj7\" (UID: \"5cca170b-7a55-45a9-a701-a64f70a691cf\") " pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.685626 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.685609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzk5\" (UniqueName: \"kubernetes.io/projected/603a79c1-ffea-470f-a6a6-e371e95c912b-kube-api-access-xhzk5\") pod \"node-ca-rbjrd\" (UID: \"603a79c1-ffea-470f-a6a6-e371e95c912b\") " pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.685803 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.685788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldh4g\" (UniqueName: \"kubernetes.io/projected/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-kube-api-access-ldh4g\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:56.756797 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.756768 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:25:56.778644 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.778798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-sys\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.778798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778673 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81611daa-28c5-4559-9b25-303c82f4e611-host-slash\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.778798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778757 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-sys\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.778798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778783 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-systemd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778807 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81611daa-28c5-4559-9b25-303c82f4e611-host-slash\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778810 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778812 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81611daa-28c5-4559-9b25-303c82f4e611-iptables-alerter-script\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778849 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-etc-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778866 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778880 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-etc-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778886 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-tmp\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-systemd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778913 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-systemd-units\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-var-lib-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-systemd-units\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778976 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-var-lib-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.778992 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-conf\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-var-lib-kubelet\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779070 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-systemd\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779097 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zlx9\" (UniqueName: \"kubernetes.io/projected/8073a57e-76f8-4cf5-b97f-361ee184ba8b-kube-api-access-5zlx9\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysctl-conf\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-kubelet-config\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779163 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-systemd\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-var-lib-kubelet\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779194 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-run\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-kubelet-config\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779236 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-run\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc99h\" (UniqueName: \"kubernetes.io/projected/81611daa-28c5-4559-9b25-303c82f4e611-kube-api-access-lc99h\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779281 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-ovn\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779343 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81611daa-28c5-4559-9b25-303c82f4e611-iptables-alerter-script\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-bin\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-bin\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779399 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-ovn\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.779543 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.779403 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:56.779473 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:25:57.279456533 +0000 UTC m=+2.077791588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779491 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-modprobe-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-modprobe-d\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779533 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-kubernetes\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779560 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-lib-modules\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxc5\" (UniqueName: \"kubernetes.io/projected/4a2c218c-6182-41b8-9594-b025d0106ea7-kube-api-access-llxc5\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-node-log\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779631 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-log-socket\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-kubelet\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779672 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-kubernetes\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-node-log\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-dbus\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779719 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-log-socket\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779725 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-config\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779768 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-lib-modules\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cadb7eb2-3604-4782-a39f-b71d6487721d-ovn-node-metrics-cert\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780238 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779789 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/181f3dc2-17a4-4478-bb79-9effb8c16bac-dbus\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-kubelet\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779858 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysconfig\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779920 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-host\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-slash\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779988 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-host\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.779984 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780003 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-slash\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780034 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-sysconfig\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780039 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-ovn-kubernetes\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-netd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-tuned\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780117 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-cni-netd\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a2c218c-6182-41b8-9594-b025d0106ea7-tmp-dir\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780156 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-netns\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780177 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-env-overrides\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780202 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t6rb\" (UniqueName: \"kubernetes.io/projected/cadb7eb2-3604-4782-a39f-b71d6487721d-kube-api-access-6t6rb\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780227 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a2c218c-6182-41b8-9594-b025d0106ea7-hosts-file\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.780922 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780250 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780274 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-script-lib\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780401 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-config\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780476 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a2c218c-6182-41b8-9594-b025d0106ea7-hosts-file\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780480 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a2c218c-6182-41b8-9594-b025d0106ea7-tmp-dir\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-host-run-netns\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780587 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cadb7eb2-3604-4782-a39f-b71d6487721d-run-openvswitch\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780629 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-env-overrides\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.780807 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cadb7eb2-3604-4782-a39f-b71d6487721d-ovnkube-script-lib\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.781491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.781428 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-tmp\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.781927 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.781910 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cadb7eb2-3604-4782-a39f-b71d6487721d-ovn-node-metrics-cert\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.782969 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.782953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8073a57e-76f8-4cf5-b97f-361ee184ba8b-etc-tuned\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.787282 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.787234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc99h\" (UniqueName: \"kubernetes.io/projected/81611daa-28c5-4559-9b25-303c82f4e611-kube-api-access-lc99h\") pod \"iptables-alerter-27hxz\" (UID: \"81611daa-28c5-4559-9b25-303c82f4e611\") " pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.789967 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.788532 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zlx9\" (UniqueName: \"kubernetes.io/projected/8073a57e-76f8-4cf5-b97f-361ee184ba8b-kube-api-access-5zlx9\") pod \"tuned-hlkbz\" (UID: \"8073a57e-76f8-4cf5-b97f-361ee184ba8b\") " pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.790436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.790073 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t6rb\" (UniqueName: \"kubernetes.io/projected/cadb7eb2-3604-4782-a39f-b71d6487721d-kube-api-access-6t6rb\") pod \"ovnkube-node-82kl4\" (UID: \"cadb7eb2-3604-4782-a39f-b71d6487721d\") " pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.790497 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.790453 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxc5\" (UniqueName: \"kubernetes.io/projected/4a2c218c-6182-41b8-9594-b025d0106ea7-kube-api-access-llxc5\") pod \"node-resolver-k8ptl\" (UID: \"4a2c218c-6182-41b8-9594-b025d0106ea7\") " pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.892439 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.892360 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:25:56.897171 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.897153 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" Jun 11 13:25:56.900640 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.900617 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef73d619_8584_479c_8450_74f1289e09c3.slice/crio-3fdd25dff9c4c0d51fbfd008a5af138dad91daab7d314915fedc43b8a00fd4dc WatchSource:0}: Error finding container 3fdd25dff9c4c0d51fbfd008a5af138dad91daab7d314915fedc43b8a00fd4dc: Status 404 returned error can't find the container with id 3fdd25dff9c4c0d51fbfd008a5af138dad91daab7d314915fedc43b8a00fd4dc Jun 11 13:25:56.904271 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.904250 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ec9c4b_40b9_41f3_8d17_8eeeb2436260.slice/crio-c221feba090bdacc2914de86a049ca7092295e84b3275312d228daab24ed48f0 WatchSource:0}: Error finding container c221feba090bdacc2914de86a049ca7092295e84b3275312d228daab24ed48f0: Status 404 returned error can't find the container with id c221feba090bdacc2914de86a049ca7092295e84b3275312d228daab24ed48f0 Jun 11 13:25:56.923196 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.923173 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbjrd" Jun 11 13:25:56.928343 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.928325 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" Jun 11 13:25:56.931456 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.931391 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603a79c1_ffea_470f_a6a6_e371e95c912b.slice/crio-629a7dfcc96d677cf9e6f0da3970bb433d764cd3bc5013aa9d1b14e41e30439d WatchSource:0}: Error finding container 629a7dfcc96d677cf9e6f0da3970bb433d764cd3bc5013aa9d1b14e41e30439d: Status 404 returned error can't find the container with id 629a7dfcc96d677cf9e6f0da3970bb433d764cd3bc5013aa9d1b14e41e30439d Jun 11 13:25:56.934193 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.934178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6dth" Jun 11 13:25:56.937442 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.937420 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cca170b_7a55_45a9_a701_a64f70a691cf.slice/crio-8caeb9cad7dedebd4ecdc39428698ed785d029256807b645f4e0332bf2d529a2 WatchSource:0}: Error finding container 8caeb9cad7dedebd4ecdc39428698ed785d029256807b645f4e0332bf2d529a2: Status 404 returned error can't find the container with id 8caeb9cad7dedebd4ecdc39428698ed785d029256807b645f4e0332bf2d529a2 Jun 11 13:25:56.941545 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.941521 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6d88ca_1fdd_4c64_ab0d_68298eac9d29.slice/crio-5f8d496c5f84965d68147c670cd1da0e814ea8aca7e2cbdeb8d9b30f191ff60e WatchSource:0}: Error finding container 5f8d496c5f84965d68147c670cd1da0e814ea8aca7e2cbdeb8d9b30f191ff60e: Status 404 returned error can't find the container with id 5f8d496c5f84965d68147c670cd1da0e814ea8aca7e2cbdeb8d9b30f191ff60e Jun 11 13:25:56.942177 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.942127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-27hxz" Jun 11 13:25:56.947822 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.947803 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" Jun 11 13:25:56.950157 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.950130 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81611daa_28c5_4559_9b25_303c82f4e611.slice/crio-d232de40c82a304bb9e6754bfffc7fb91b8c245a17c7798a96a4076518048422 WatchSource:0}: Error finding container d232de40c82a304bb9e6754bfffc7fb91b8c245a17c7798a96a4076518048422: Status 404 returned error can't find the container with id d232de40c82a304bb9e6754bfffc7fb91b8c245a17c7798a96a4076518048422 Jun 11 13:25:56.952897 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.952878 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k8ptl" Jun 11 13:25:56.955807 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.955788 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8073a57e_76f8_4cf5_b97f_361ee184ba8b.slice/crio-97840ed450a552be04f9fade1c24e261b8eaf125eda58f65e3f1746db0760fe7 WatchSource:0}: Error finding container 97840ed450a552be04f9fade1c24e261b8eaf125eda58f65e3f1746db0760fe7: Status 404 returned error can't find the container with id 97840ed450a552be04f9fade1c24e261b8eaf125eda58f65e3f1746db0760fe7 Jun 11 13:25:56.957477 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:56.957462 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:25:56.960662 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.960639 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2c218c_6182_41b8_9594_b025d0106ea7.slice/crio-9d28ea92a30de27ec36f95d8cab5592fa7eee0be743685d74a5b165614f3389e WatchSource:0}: Error finding container 9d28ea92a30de27ec36f95d8cab5592fa7eee0be743685d74a5b165614f3389e: Status 404 returned error can't find the container with id 9d28ea92a30de27ec36f95d8cab5592fa7eee0be743685d74a5b165614f3389e Jun 11 13:25:56.964940 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:25:56.964922 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadb7eb2_3604_4782_a39f_b71d6487721d.slice/crio-a3060803371aeef8265f2a48c479e27b09cfa9310a2b3cec8126367e46666a46 WatchSource:0}: Error finding container a3060803371aeef8265f2a48c479e27b09cfa9310a2b3cec8126367e46666a46: Status 404 returned error can't find the container with id a3060803371aeef8265f2a48c479e27b09cfa9310a2b3cec8126367e46666a46 Jun 11 13:25:57.101709 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.101670 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:25:57.182889 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.182807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:57.183051 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.182975 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:57.183051 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.183047 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:25:58.183027987 +0000 UTC m=+2.981363059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:57.283866 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.283826 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:57.284022 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.283881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:57.284078 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284050 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:25:57.284078 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284071 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:25:57.284187 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284084 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:57.284187 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284173 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:25:58.284150877 +0000 UTC m=+3.082485927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:57.285793 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284579 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:57.285793 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:57.284634 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:25:58.284618499 +0000 UTC m=+3.082953552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:57.612998 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.612884 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:20:56 +0000 UTC" deadline="2027-11-19 18:30:53.169274195 +0000 UTC" Jun 11 13:25:57.612998 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.612947 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12629h4m55.556331668s" Jun 11 13:25:57.682925 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.682886 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbjrd" event={"ID":"603a79c1-ffea-470f-a6a6-e371e95c912b","Type":"ContainerStarted","Data":"629a7dfcc96d677cf9e6f0da3970bb433d764cd3bc5013aa9d1b14e41e30439d"} Jun 11 13:25:57.697846 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.697811 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hsvkx" event={"ID":"ef73d619-8584-479c-8450-74f1289e09c3","Type":"ContainerStarted","Data":"3fdd25dff9c4c0d51fbfd008a5af138dad91daab7d314915fedc43b8a00fd4dc"} Jun 11 13:25:57.710722 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.710593 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" event={"ID":"8073a57e-76f8-4cf5-b97f-361ee184ba8b","Type":"ContainerStarted","Data":"97840ed450a552be04f9fade1c24e261b8eaf125eda58f65e3f1746db0760fe7"} Jun 11 13:25:57.732680 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.732596 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:25:57.734450 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.734365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-27hxz" event={"ID":"81611daa-28c5-4559-9b25-303c82f4e611","Type":"ContainerStarted","Data":"d232de40c82a304bb9e6754bfffc7fb91b8c245a17c7798a96a4076518048422"} Jun 11 13:25:57.747885 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.747851 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6dth" event={"ID":"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29","Type":"ContainerStarted","Data":"5f8d496c5f84965d68147c670cd1da0e814ea8aca7e2cbdeb8d9b30f191ff60e"} Jun 11 13:25:57.791431 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.791391 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" event={"ID":"56ec9c4b-40b9-41f3-8d17-8eeeb2436260","Type":"ContainerStarted","Data":"c221feba090bdacc2914de86a049ca7092295e84b3275312d228daab24ed48f0"} Jun 11 13:25:57.807282 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.807249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"a3060803371aeef8265f2a48c479e27b09cfa9310a2b3cec8126367e46666a46"} Jun 11 13:25:57.813796 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.813765 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k8ptl" event={"ID":"4a2c218c-6182-41b8-9594-b025d0106ea7","Type":"ContainerStarted","Data":"9d28ea92a30de27ec36f95d8cab5592fa7eee0be743685d74a5b165614f3389e"} Jun 11 13:25:57.829952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:57.829917 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerStarted","Data":"8caeb9cad7dedebd4ecdc39428698ed785d029256807b645f4e0332bf2d529a2"} Jun 11 13:25:58.191529 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.191462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:58.191700 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.191638 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:58.191861 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.191702 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:26:00.19168231 +0000 UTC m=+4.990017365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:25:58.292875 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.292833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:58.293035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.292889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:58.293106 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293075 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:25:58.293106 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293093 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:25:58.293106 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293106 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:58.293251 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293164 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:26:00.293145478 +0000 UTC m=+5.091480529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:25:58.293584 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293567 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:58.293695 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.293619 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:26:00.293603633 +0000 UTC m=+5.091938687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:25:58.613443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.613395 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:20:56 +0000 UTC" deadline="2027-12-21 04:55:17.488424924 +0000 UTC" Jun 11 13:25:58.613443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.613439 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13383h29m18.874993057s" Jun 11 13:25:58.633951 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.633920 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:25:58.634122 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.634050 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:25:58.634183 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.634143 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:25:58.634253 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.634233 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:25:58.634323 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:25:58.634296 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:25:58.634392 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:25:58.634369 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:00.211619 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.211578 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:00.212106 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.211718 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:00.212106 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.211815 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:26:04.211795228 +0000 UTC m=+9.010130276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:00.312972 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.312917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:00.312972 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.312974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:00.313222 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313168 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:00.313222 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313189 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:00.313222 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313202 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:00.313370 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313262 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:26:04.313242746 +0000 UTC m=+9.111577880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:00.313370 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313340 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:00.313476 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.313378 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:26:04.31336661 +0000 UTC m=+9.111701658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:00.634493 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.634414 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:00.634663 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.634578 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:00.634770 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.634697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:00.634865 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.634843 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:00.634927 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:00.634883 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:00.634977 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:00.634954 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:02.633684 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:02.633844 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:02.633984 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:02.634081 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:02.634130 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:02.634456 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:02.634205 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:04.248164 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.248124 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:04.248630 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.248316 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:04.248630 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.248401 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:26:12.24837835 +0000 UTC m=+17.046713400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:04.348811 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.348490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:04.348811 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.348541 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:04.348811 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348743 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:04.348811 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348767 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:04.348811 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348781 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:04.349198 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348743 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:04.349198 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348837 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:26:12.348819504 +0000 UTC m=+17.147154566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:04.349198 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.348953 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:26:12.348925739 +0000 UTC m=+17.147260798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.634417 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.634539 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.634594 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.634718 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:04.634596 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:04.634930 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:04.634840 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:06.634009 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:06.633912 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:06.634459 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:06.633912 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:06.634459 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:06.634034 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:06.634459 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:06.634116 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:06.634459 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:06.633924 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:06.634459 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:06.634205 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:08.634096 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:08.634068 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:08.634096 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:08.634094 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:08.634445 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:08.634181 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:08.634445 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:08.634235 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:08.634445 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:08.634345 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:08.634445 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:08.634429 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:10.634079 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:10.634046 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:10.634511 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:10.634047 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:10.634511 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:10.634165 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:10.634511 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:10.634047 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:10.634511 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:10.634226 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:10.634511 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:10.634326 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:12.309088 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.309047 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:12.309628 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.309218 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:12.309628 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.309307 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.309285031 +0000 UTC m=+33.107620079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:12.410185 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.410145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:12.410185 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.410195 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410307 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410325 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410345 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410354 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410387 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.410366898 +0000 UTC m=+33.208701960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:12.410443 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.410407 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.410397702 +0000 UTC m=+33.208732750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:12.634430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.634355 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:12.634430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.634380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:12.634430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:12.634390 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:12.634658 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.634489 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:12.634658 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.634584 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:12.634741 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:12.634668 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:14.634554 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:14.634518 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:14.635099 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:14.634562 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:14.635099 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:14.634567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:14.635099 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:14.634652 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:14.635099 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:14.634720 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:14.635099 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:14.634809 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:16.634213 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:16.634178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:16.634654 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:16.634297 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:16.634654 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:16.634303 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:16.634654 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:16.634323 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:16.634654 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:16.634404 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:16.634654 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:16.634486 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:17.876447 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.876194 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" event={"ID":"8073a57e-76f8-4cf5-b97f-361ee184ba8b","Type":"ContainerStarted","Data":"3a0a7b45f2146a9e1c9bddbeebe087d7fce4ead58d91aa9b044ff34411c22760"} Jun 11 13:26:17.877838 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.877811 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6dth" event={"ID":"4b6d88ca-1fdd-4c64-ab0d-68298eac9d29","Type":"ContainerStarted","Data":"e5f531cb1abeabbe9948e69c52894d55360077e4f8100241ee4b8d021042bddb"} Jun 11 13:26:17.880138 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.880112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" event={"ID":"67f0da86fafeabede4d4debcf58e01a6","Type":"ContainerStarted","Data":"8ced6539c3450fa4c42afafbdb582960bbad5415e2408276e97b9ccd20c4bcb6"} Jun 11 13:26:17.891524 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.891501 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:26:17.891919 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.891896 2552 generic.go:356] "Generic (PLEG): container finished" podID="cadb7eb2-3604-4782-a39f-b71d6487721d" containerID="623bd70642c567e6d364451103983cf597a4e45751ec9acb09b352ec2ce85de8" exitCode=1 Jun 11 13:26:17.891997 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.891909 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hlkbz" podStartSLOduration=2.646178119 podStartE2EDuration="22.891894592s" totalImagesPullingTime="20.245716473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:17.891371188 +0000 UTC m=+22.689706281" watchObservedRunningTime="2026-06-11 13:26:17.891894592 +0000 UTC m=+22.690229663" Jun 11 13:26:17.892048 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.891934 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"dfc6054d440c121da6354c2e835a58f8c113018f3d61476afc9a7a18e3cdc687"} Jun 11 13:26:17.892093 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.892075 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"18762cfb834b0dc41b0c482e2a2ec6203fc698c3c941df3e87ac78fbe24adc20"} Jun 11 13:26:17.892168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.892117 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"beacd9914d0e76365720aaf5c7c502aaf9c9a7d9ce1703f8a7456d4e07bc1e37"} Jun 11 13:26:17.892168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.892152 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerDied","Data":"623bd70642c567e6d364451103983cf597a4e45751ec9acb09b352ec2ce85de8"} Jun 11 13:26:17.892228 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.892183 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"2618beab55365d75a5621203a702b726d5548416279e76749b8acb8f428ac3ca"} Jun 11 13:26:17.916620 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.916570 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v6dth" podStartSLOduration=2.260443055 podStartE2EDuration="22.916554118s" totalImagesPullingTime="20.656111063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:17.916484628 +0000 UTC m=+22.714819698" watchObservedRunningTime="2026-06-11 13:26:17.916554118 +0000 UTC m=+22.714889184" Jun 11 13:26:17.917133 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:17.917101 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" podStartSLOduration=21.917092032 podStartE2EDuration="21.917092032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:17.902513284 +0000 UTC m=+22.700848357" watchObservedRunningTime="2026-06-11 13:26:17.917092032 +0000 UTC m=+22.715427112" Jun 11 13:26:18.634377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.634168 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:18.634528 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.634171 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:18.634528 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:18.634406 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:18.634528 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.634228 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:18.634528 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:18.634500 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:18.634696 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:18.634588 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:18.895964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.895876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hsvkx" event={"ID":"ef73d619-8584-479c-8450-74f1289e09c3","Type":"ContainerStarted","Data":"85fde5ffb53b4a0e067194a2cc5a765a76007e0efaef24c8a1c1ee456558a1a5"} Jun 11 13:26:18.897640 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.897612 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-27hxz" event={"ID":"81611daa-28c5-4559-9b25-303c82f4e611","Type":"ContainerStarted","Data":"ba3b47a0b9d2dd878c088343e57a78eb44bd464716d6bc2ac037585ef2b7b143"} Jun 11 13:26:18.899367 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.899339 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" event={"ID":"56ec9c4b-40b9-41f3-8d17-8eeeb2436260","Type":"ContainerStarted","Data":"0e8411a5b4d487106a1d32bd975a0dbaddffeb8077a2fa3eb5de5ba7d277e745"} Jun 11 13:26:18.900944 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.900920 2552 generic.go:356] "Generic (PLEG): container finished" podID="012fe33fc29e15bcc8a12cd15f2aaf64" containerID="8c52f09ea8b4f7a384630e0769ef6f24fa6c7dc605b90290f4e4b59110e589ea" exitCode=0 Jun 11 13:26:18.901083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.901001 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"012fe33fc29e15bcc8a12cd15f2aaf64","Type":"ContainerDied","Data":"8c52f09ea8b4f7a384630e0769ef6f24fa6c7dc605b90290f4e4b59110e589ea"} Jun 11 13:26:18.904090 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.904073 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:26:18.904506 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.904485 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"7e13ccf885687c5c9774e9973c6ca16cdf84c9a24506f27d339ea513e87df185"} Jun 11 13:26:18.905914 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.905887 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k8ptl" event={"ID":"4a2c218c-6182-41b8-9594-b025d0106ea7","Type":"ContainerStarted","Data":"5d1edd65f053f1e96ed0e021da82c2637d46e9dc76ebdd1f4a66e86facf0d11b"} Jun 11 13:26:18.907594 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.907539 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="247d7d4e078c8d2bdfd64eb803cb762136cc51449630472bb54f79500b5bfc72" exitCode=0 Jun 11 13:26:18.907700 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.907622 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"247d7d4e078c8d2bdfd64eb803cb762136cc51449630472bb54f79500b5bfc72"} Jun 11 13:26:18.909726 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.909681 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbjrd" event={"ID":"603a79c1-ffea-470f-a6a6-e371e95c912b","Type":"ContainerStarted","Data":"75dbfc113ed3b9a1a10330e7598182339b6e2c73e3f95eaba09c1e06db8ce42f"} Jun 11 13:26:18.912436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.912394 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hsvkx" podStartSLOduration=3.638533475 podStartE2EDuration="23.912378266s" totalImagesPullingTime="20.273844791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:18.912013723 +0000 UTC m=+23.710348786" watchObservedRunningTime="2026-06-11 13:26:18.912378266 +0000 UTC m=+23.710713337" Jun 11 13:26:18.943513 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.943319 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-27hxz" podStartSLOduration=3.719102566 podStartE2EDuration="23.943297824s" totalImagesPullingTime="20.224195258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:18.942924798 +0000 UTC m=+23.741259879" watchObservedRunningTime="2026-06-11 13:26:18.943297824 +0000 UTC m=+23.741632897" Jun 11 13:26:18.955718 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:18.955612 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k8ptl" podStartSLOduration=3.714483719 podStartE2EDuration="23.955590939s" totalImagesPullingTime="20.24110722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:18.955146774 +0000 UTC m=+23.753481845" watchObservedRunningTime="2026-06-11 13:26:18.955590939 +0000 UTC m=+23.753926052" Jun 11 13:26:19.569554 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.569407 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 13:26:19.635909 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.635795 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T13:26:19.569423644Z","UUID":"a2374f7b-f8e6-4115-a26c-12ba70cbb3b4","Handler":null,"Name":"","Endpoint":""} Jun 11 13:26:19.637547 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.637516 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 13:26:19.637676 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.637558 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 13:26:19.914793 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.914693 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" event={"ID":"56ec9c4b-40b9-41f3-8d17-8eeeb2436260","Type":"ContainerStarted","Data":"cd8b2243f65aa5c3473a6608ec1c38e9380031069672b8b37e2f8c7feea31a6b"} Jun 11 13:26:19.916669 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.916641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"012fe33fc29e15bcc8a12cd15f2aaf64","Type":"ContainerStarted","Data":"6a6791b21051be638bb0f3d2ad6492ef0a813b2131dfd8b420332031e88caf95"} Jun 11 13:26:19.930273 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.930227 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rbjrd" podStartSLOduration=4.660458762 podStartE2EDuration="24.930211337s" totalImagesPullingTime="20.269752575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:18.980869999 +0000 UTC m=+23.779205071" watchObservedRunningTime="2026-06-11 13:26:19.930211337 +0000 UTC m=+24.728546390" Jun 11 13:26:19.930806 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:19.930780 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" podStartSLOduration=23.930774048 podStartE2EDuration="23.930774048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:19.930197803 +0000 UTC m=+24.728532869" watchObservedRunningTime="2026-06-11 13:26:19.930774048 +0000 UTC m=+24.729109117" Jun 11 13:26:20.633829 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.633609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:20.634018 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.633609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:20.634018 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:20.633908 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:20.634018 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.633610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:20.634018 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:20.633990 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:20.634209 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:20.634063 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:20.921064 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.921029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" event={"ID":"56ec9c4b-40b9-41f3-8d17-8eeeb2436260","Type":"ContainerStarted","Data":"f28f71355aaddc1a18e821a03e6c166e4d836b911a492ef3fdc544d25d3188f1"} Jun 11 13:26:20.924385 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.924356 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:26:20.924827 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.924807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"688a773c7fc8db729e682aa9d6538cb2b36eb328b4bd865abc1d6f695ff72b56"} Jun 11 13:26:20.937578 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:20.937535 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99bfv" podStartSLOduration=3.49812615 podStartE2EDuration="25.93751887s" totalImagesPullingTime="22.43939272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:20.936805382 +0000 UTC m=+25.735140456" watchObservedRunningTime="2026-06-11 13:26:20.93751887 +0000 UTC m=+25.735853934" Jun 11 13:26:21.729064 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:21.729029 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:26:21.729720 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:21.729690 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:26:22.634097 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.634074 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:22.634476 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.634104 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:22.634476 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.634105 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:22.634476 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:22.634181 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:22.634476 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:22.634255 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:22.634476 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:22.634355 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:22.932659 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.932578 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:26:22.932962 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.932940 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"5f35cce22e79e7a472a2570e5d29adfb078b6830b9f99ef68047eb80eb09b173"} Jun 11 13:26:22.933193 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.933172 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:22.933355 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.933225 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:22.933402 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.933380 2552 scope.go:117] "RemoveContainer" containerID="623bd70642c567e6d364451103983cf597a4e45751ec9acb09b352ec2ce85de8" Jun 11 13:26:22.951684 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:22.951658 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:23.942347 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:23.942314 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:26:23.942920 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:23.942808 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" event={"ID":"cadb7eb2-3604-4782-a39f-b71d6487721d","Type":"ContainerStarted","Data":"1576fb71cb12cfb15eaabc4e1a8a13e374ec96d768645eb5506cdad3d98d936a"} Jun 11 13:26:23.943314 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:23.943280 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:23.970261 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:23.968779 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:23.970947 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:23.970896 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" podStartSLOduration=8.691190072 podStartE2EDuration="28.97088019s" totalImagesPullingTime="20.279690118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:23.970076893 +0000 UTC m=+28.768411993" watchObservedRunningTime="2026-06-11 13:26:23.97088019 +0000 UTC m=+28.769215265" Jun 11 13:26:24.633834 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.633802 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:24.633834 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.633829 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:24.634075 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.633810 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:24.634075 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.633937 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:24.634075 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.634026 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:24.634234 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.634133 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:24.829643 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.829611 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:26:24.829870 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.829803 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 13:26:24.830258 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.830237 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hsvkx" Jun 11 13:26:24.886221 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.886100 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rsrkm"] Jun 11 13:26:24.890870 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.890842 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5d9lx"] Jun 11 13:26:24.891527 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.891497 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95sfl"] Jun 11 13:26:24.945514 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.945474 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:24.945514 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.945472 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:24.945514 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:24.945483 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:24.946200 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.946094 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:24.946386 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.946264 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:24.946386 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:24.946349 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:25.949377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:25.949344 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerStarted","Data":"f6b5718021d53d9c8ba233ed92c6b86a403c4f29f4bb2a6516567cd43928f9a7"} Jun 11 13:26:26.633580 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:26.633552 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:26.633748 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:26.633658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:26.633748 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:26.633679 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:26.633748 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:26.633701 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:26.633889 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:26.633786 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:26.633889 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:26.633850 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:26.953523 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:26.953487 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="f6b5718021d53d9c8ba233ed92c6b86a403c4f29f4bb2a6516567cd43928f9a7" exitCode=0 Jun 11 13:26:26.953871 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:26.953543 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"f6b5718021d53d9c8ba233ed92c6b86a403c4f29f4bb2a6516567cd43928f9a7"} Jun 11 13:26:27.958514 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:27.958272 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="474868d544e4e3183efa18968b408cc817a1a4274a0ca06c29ec38e364f18cd7" exitCode=0 Jun 11 13:26:27.958514 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:27.958313 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"474868d544e4e3183efa18968b408cc817a1a4274a0ca06c29ec38e364f18cd7"} Jun 11 13:26:28.332211 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.332180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:28.332350 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.332293 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:28.332406 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.332350 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:27:00.332333754 +0000 UTC m=+65.130668803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:28.432860 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.432824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:28.433018 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.432872 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:28.433018 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.432976 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:28.433093 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.432977 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:28.433093 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.433044 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret podName:181f3dc2-17a4-4478-bb79-9effb8c16bac nodeName:}" failed. No retries permitted until 2026-06-11 13:27:00.433022819 +0000 UTC m=+65.231357866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret") pod "global-pull-secret-syncer-rsrkm" (UID: "181f3dc2-17a4-4478-bb79-9effb8c16bac") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:28.433093 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.433054 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:28.433093 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.433071 2552 projected.go:196] Error preparing data for projected volume kube-api-access-cbjcv for pod openshift-network-diagnostics/network-check-target-95sfl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:28.433288 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.433123 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv podName:3859d18e-8071-4203-be45-f09afac1ea0c nodeName:}" failed. No retries permitted until 2026-06-11 13:27:00.433108278 +0000 UTC m=+65.231443341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbjcv" (UniqueName: "kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv") pod "network-check-target-95sfl" (UID: "3859d18e-8071-4203-be45-f09afac1ea0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:28.634473 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.634442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:28.634602 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.634442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:28.634602 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.634578 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95sfl" podUID="3859d18e-8071-4203-be45-f09afac1ea0c" Jun 11 13:26:28.634702 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.634457 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:28.634702 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.634694 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsrkm" podUID="181f3dc2-17a4-4478-bb79-9effb8c16bac" Jun 11 13:26:28.634887 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:28.634627 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:26:28.963204 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.963171 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="619930a0cca3d5694bd9588ffcaeb5a20f93077ad4fff460d8b5f1214df13538" exitCode=0 Jun 11 13:26:28.963541 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:28.963213 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"619930a0cca3d5694bd9588ffcaeb5a20f93077ad4fff460d8b5f1214df13538"} Jun 11 13:26:29.443292 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:29.443257 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:29.518287 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:29.518253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:30.539615 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.539588 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeReady" Jun 11 13:26:30.540237 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.539754 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 13:26:30.579023 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.578991 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vltl5"] Jun 11 13:26:30.581888 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.581861 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.582351 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.582318 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-49krr"] Jun 11 13:26:30.584111 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.584076 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 13:26:30.584111 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.584093 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 13:26:30.584285 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.584186 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7xbz\"" Jun 11 13:26:30.585236 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.585214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.587119 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.587103 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mqppv\"" Jun 11 13:26:30.587312 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.587287 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 13:26:30.587424 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.587288 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 13:26:30.587566 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.587552 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 13:26:30.594186 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.593420 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vltl5"] Jun 11 13:26:30.594313 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.594293 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49krr"] Jun 11 13:26:30.633691 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.633655 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:26:30.633895 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.633699 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:26:30.633895 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.633663 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:26:30.635977 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.635953 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:26:30.636220 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.636190 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:26:30.636331 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.636193 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9kw6\"" Jun 11 13:26:30.636331 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.636254 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 13:26:30.636331 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.636313 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 13:26:30.636511 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.636336 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fzt5j\"" Jun 11 13:26:30.749011 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.748976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc1b6fd-fdba-4a4d-b064-a4923203db5e-cert\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.749011 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.749019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp9fg\" (UniqueName: \"kubernetes.io/projected/acc1b6fd-fdba-4a4d-b064-a4923203db5e-kube-api-access-rp9fg\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.749266 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.749112 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235b6f00-bae2-4e2c-8734-31ae2fb9516f-tmp-dir\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.749266 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.749187 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.749266 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.749216 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fdw7\" (UniqueName: \"kubernetes.io/projected/235b6f00-bae2-4e2c-8734-31ae2fb9516f-kube-api-access-2fdw7\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.749266 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.749254 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/235b6f00-bae2-4e2c-8734-31ae2fb9516f-config-volume\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.753430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.753395 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:30.850720 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235b6f00-bae2-4e2c-8734-31ae2fb9516f-tmp-dir\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.850720 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.850720 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fdw7\" (UniqueName: \"kubernetes.io/projected/235b6f00-bae2-4e2c-8734-31ae2fb9516f-kube-api-access-2fdw7\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.851009 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/235b6f00-bae2-4e2c-8734-31ae2fb9516f-config-volume\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.851009 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850856 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc1b6fd-fdba-4a4d-b064-a4923203db5e-cert\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.851009 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:30.850875 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:30.851009 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:30.850942 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:26:31.350922618 +0000 UTC m=+36.149257683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:30.851009 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.850878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp9fg\" (UniqueName: \"kubernetes.io/projected/acc1b6fd-fdba-4a4d-b064-a4923203db5e-kube-api-access-rp9fg\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.851306 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.851032 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235b6f00-bae2-4e2c-8734-31ae2fb9516f-tmp-dir\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.851560 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.851537 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/235b6f00-bae2-4e2c-8734-31ae2fb9516f-config-volume\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.855161 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.855124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:30.855949 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.855929 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acc1b6fd-fdba-4a4d-b064-a4923203db5e-cert\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.859395 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.859370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp9fg\" (UniqueName: \"kubernetes.io/projected/acc1b6fd-fdba-4a4d-b064-a4923203db5e-kube-api-access-rp9fg\") pod \"ingress-canary-49krr\" (UID: \"acc1b6fd-fdba-4a4d-b064-a4923203db5e\") " pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:30.859395 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.859385 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fdw7\" (UniqueName: \"kubernetes.io/projected/235b6f00-bae2-4e2c-8734-31ae2fb9516f-kube-api-access-2fdw7\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:30.901589 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:30.901555 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49krr" Jun 11 13:26:31.061268 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:31.058265 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49krr"] Jun 11 13:26:31.081286 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:26:31.080019 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc1b6fd_fdba_4a4d_b064_a4923203db5e.slice/crio-1ddb5b1f2be4678e2a9e70b506795bdedbf7c6133bfc2121db13c8caa06dfaf3 WatchSource:0}: Error finding container 1ddb5b1f2be4678e2a9e70b506795bdedbf7c6133bfc2121db13c8caa06dfaf3: Status 404 returned error can't find the container with id 1ddb5b1f2be4678e2a9e70b506795bdedbf7c6133bfc2121db13c8caa06dfaf3 Jun 11 13:26:31.355080 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:31.355032 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:31.355249 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:31.355194 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:31.355327 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:31.355275 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:26:32.355252917 +0000 UTC m=+37.153587967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:31.971867 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:31.971832 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49krr" event={"ID":"acc1b6fd-fdba-4a4d-b064-a4923203db5e","Type":"ContainerStarted","Data":"1ddb5b1f2be4678e2a9e70b506795bdedbf7c6133bfc2121db13c8caa06dfaf3"} Jun 11 13:26:32.364053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:32.364008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:32.364247 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:32.364154 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:32.364247 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:32.364223 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:26:34.364204468 +0000 UTC m=+39.162539521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:33.979615 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:33.979577 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="970e5a9d542a4da46fbe60cb98822f6376d6ad341f648f433903acac3f494d6a" exitCode=0 Jun 11 13:26:33.980322 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:33.979627 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"970e5a9d542a4da46fbe60cb98822f6376d6ad341f648f433903acac3f494d6a"} Jun 11 13:26:34.382471 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:34.382428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:34.382665 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:34.382608 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:34.382758 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:34.382693 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:26:38.382669139 +0000 UTC m=+43.181004192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:34.984202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:34.984174 2552 generic.go:356] "Generic (PLEG): container finished" podID="5cca170b-7a55-45a9-a701-a64f70a691cf" containerID="f182a21370bb60f567ad2ab93482d588d338cad2ad981ddc25adb70d9d2925dd" exitCode=0 Jun 11 13:26:34.984567 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:34.984222 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerDied","Data":"f182a21370bb60f567ad2ab93482d588d338cad2ad981ddc25adb70d9d2925dd"} Jun 11 13:26:35.219823 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:35.219719 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:35.278159 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:35.278125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:35.989808 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:35.989772 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" event={"ID":"5cca170b-7a55-45a9-a701-a64f70a691cf","Type":"ContainerStarted","Data":"a58a31b46f5a820fe1d0f4e1d9950b1790097d4feda58fff9e17ccd32f7124a0"} Jun 11 13:26:35.991129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:35.991107 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49krr" event={"ID":"acc1b6fd-fdba-4a4d-b064-a4923203db5e","Type":"ContainerStarted","Data":"b67915e4ac1d28e3f724ca0355845bbc4b7a361c30fa8471f3e80fce647ea4a9"} Jun 11 13:26:36.012635 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:36.012588 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d2wj7" podStartSLOduration=8.513258466 podStartE2EDuration="41.012575105s" totalImagesPullingTime="32.499316639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:36.011999645 +0000 UTC m=+40.810334715" watchObservedRunningTime="2026-06-11 13:26:36.012575105 +0000 UTC m=+40.810910174" Jun 11 13:26:36.027084 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:36.027036 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-49krr" podStartSLOduration=2.154544925 podStartE2EDuration="6.027022853s" totalImagesPullingTime="3.872477928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:36.026475334 +0000 UTC m=+40.824810405" watchObservedRunningTime="2026-06-11 13:26:36.027022853 +0000 UTC m=+40.825357922" Jun 11 13:26:36.139114 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:36.139086 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:36.191360 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:36.191328 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:38.411152 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:38.411111 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:38.411625 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:38.411322 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:38.411625 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:38.411410 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:26:46.411385746 +0000 UTC m=+51.209720818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:38.448546 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:38.448514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:38.545745 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:38.545715 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:40.564174 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:40.564141 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:40.633858 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:40.633825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:46.289789 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:46.289753 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:46.390010 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:46.389978 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:46.464785 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:46.464750 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:26:46.464937 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:46.464846 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:46.464937 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:26:46.464912 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:27:02.464895737 +0000 UTC m=+67.263230784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:26:52.407113 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:52.407079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:52.460218 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:52.460189 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:55.966388 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:55.966361 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82kl4" Jun 11 13:26:56.112998 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:56.112963 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:56.213695 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:56.213656 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:59.505953 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:59.505917 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:26:59.604932 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:26:59.604898 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:00.363581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.363532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:27:00.365847 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.365830 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:27:00.374535 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:00.374516 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 13:27:00.374598 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:00.374584 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:28:04.374567868 +0000 UTC m=+129.172902916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : secret "metrics-daemon-secret" not found Jun 11 13:27:00.464387 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.464331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:27:00.464387 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.464387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:27:00.466704 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.466685 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 13:27:00.466782 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.466712 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:27:00.477284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.477260 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 13:27:00.478404 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.478384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/181f3dc2-17a4-4478-bb79-9effb8c16bac-original-pull-secret\") pod \"global-pull-secret-syncer-rsrkm\" (UID: \"181f3dc2-17a4-4478-bb79-9effb8c16bac\") " pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:27:00.488704 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.488684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjcv\" (UniqueName: \"kubernetes.io/projected/3859d18e-8071-4203-be45-f09afac1ea0c-kube-api-access-cbjcv\") pod \"network-check-target-95sfl\" (UID: \"3859d18e-8071-4203-be45-f09afac1ea0c\") " pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:27:00.645604 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.645510 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsrkm" Jun 11 13:27:00.661968 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.661941 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9kw6\"" Jun 11 13:27:00.669781 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.669754 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:27:00.779056 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.778905 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rsrkm"] Jun 11 13:27:00.781569 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:27:00.781538 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181f3dc2_17a4_4478_bb79_9effb8c16bac.slice/crio-6897a757de437c5eceab4f11aec078b4694c9869fc9604eebefb6fd49e4a6634 WatchSource:0}: Error finding container 6897a757de437c5eceab4f11aec078b4694c9869fc9604eebefb6fd49e4a6634: Status 404 returned error can't find the container with id 6897a757de437c5eceab4f11aec078b4694c9869fc9604eebefb6fd49e4a6634 Jun 11 13:27:00.797554 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:00.797526 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95sfl"] Jun 11 13:27:00.800859 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:27:00.800828 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3859d18e_8071_4203_be45_f09afac1ea0c.slice/crio-5ef71f867c0534f81e892374bc9511033d82571711de6f7a443f7a6eb4f0336c WatchSource:0}: Error finding container 5ef71f867c0534f81e892374bc9511033d82571711de6f7a443f7a6eb4f0336c: Status 404 returned error can't find the container with id 5ef71f867c0534f81e892374bc9511033d82571711de6f7a443f7a6eb4f0336c Jun 11 13:27:01.064706 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:01.064671 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rsrkm" event={"ID":"181f3dc2-17a4-4478-bb79-9effb8c16bac","Type":"ContainerStarted","Data":"6897a757de437c5eceab4f11aec078b4694c9869fc9604eebefb6fd49e4a6634"} Jun 11 13:27:01.065751 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:01.065704 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95sfl" event={"ID":"3859d18e-8071-4203-be45-f09afac1ea0c","Type":"ContainerStarted","Data":"5ef71f867c0534f81e892374bc9511033d82571711de6f7a443f7a6eb4f0336c"} Jun 11 13:27:02.481529 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:02.481482 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:27:02.482018 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:02.481608 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:02.482018 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:02.481694 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:27:34.481677698 +0000 UTC m=+99.280012751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:27:06.082723 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:06.082679 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rsrkm" event={"ID":"181f3dc2-17a4-4478-bb79-9effb8c16bac","Type":"ContainerStarted","Data":"cbd121d6ef6bf237639422cc4e7bcc0048d931fa01c61c468c802a95317da7d1"} Jun 11 13:27:06.084160 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:06.084132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95sfl" event={"ID":"3859d18e-8071-4203-be45-f09afac1ea0c","Type":"ContainerStarted","Data":"20a2eda7e0bb0d40416dfa18972c68e899c59a3b51f029d2741e2f90731c42d1"} Jun 11 13:27:06.084285 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:06.084196 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:27:06.097041 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:06.096999 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rsrkm" podStartSLOduration=66.713626944 podStartE2EDuration="1m11.09698647s" totalImagesPullingTime="4.383359526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:06.096471927 +0000 UTC m=+70.894807010" watchObservedRunningTime="2026-06-11 13:27:06.09698647 +0000 UTC m=+70.895321539" Jun 11 13:27:06.109787 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:06.109726 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-95sfl" podStartSLOduration=66.74925031 podStartE2EDuration="1m11.109710993s" totalImagesPullingTime="4.360460683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:06.109650026 +0000 UTC m=+70.907985097" watchObservedRunningTime="2026-06-11 13:27:06.109710993 +0000 UTC m=+70.908046053" Jun 11 13:27:07.541419 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:07.541390 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:34.499927 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:34.499880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:27:34.500253 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:34.499998 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:34.500253 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:27:34.500063 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:28:38.500048721 +0000 UTC m=+163.298383769 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:27:37.089492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:27:37.089457 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-95sfl" Jun 11 13:28:04.401650 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:28:04.401605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:28:04.402156 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:04.401761 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 13:28:04.402156 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:04.401839 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs podName:6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb nodeName:}" failed. No retries permitted until 2026-06-11 13:30:06.401816454 +0000 UTC m=+251.200151522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs") pod "network-metrics-daemon-5d9lx" (UID: "6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb") : secret "metrics-daemon-secret" not found Jun 11 13:28:33.594781 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:33.594720 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vltl5" podUID="235b6f00-bae2-4e2c-8734-31ae2fb9516f" Jun 11 13:28:33.653078 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:33.653028 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5d9lx" podUID="6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb" Jun 11 13:28:34.289225 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:28:34.289197 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vltl5" Jun 11 13:28:38.527545 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:28:38.527489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:28:38.527982 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:38.527639 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:28:38.527982 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:28:38.527718 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls podName:235b6f00-bae2-4e2c-8734-31ae2fb9516f nodeName:}" failed. No retries permitted until 2026-06-11 13:30:40.527699164 +0000 UTC m=+285.326034212 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls") pod "dns-default-vltl5" (UID: "235b6f00-bae2-4e2c-8734-31ae2fb9516f") : secret "dns-default-metrics-tls" not found Jun 11 13:28:46.633958 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:28:46.633878 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:29:08.987416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:08.987380 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:37.169492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.169445 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7"] Jun 11 13:29:37.171406 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.171390 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk"] Jun 11 13:29:37.171521 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.171502 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" Jun 11 13:29:37.173882 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.173859 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 13:29:37.174002 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.173913 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh"] Jun 11 13:29:37.174002 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.173923 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:29:37.174114 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.174016 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zldgx\"" Jun 11 13:29:37.174159 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.174127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.175715 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.175695 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.176191 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.176168 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:29:37.176320 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.176298 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-swnt2\"" Jun 11 13:29:37.176424 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.176332 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 13:29:37.176424 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.176346 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 13:29:37.176424 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.176364 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 13:29:37.177635 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.177615 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 13:29:37.177896 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.177876 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8xz52\"" Jun 11 13:29:37.177976 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.177940 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:29:37.178357 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.178340 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 13:29:37.178441 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.178396 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 13:29:37.182117 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.182098 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7"] Jun 11 13:29:37.188611 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.188591 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk"] Jun 11 13:29:37.191237 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.191216 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh"] Jun 11 13:29:37.220026 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.219999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3234bb8c-b7c8-4df9-965d-08ee7bbda103-config\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.220182 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220030 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tt6v\" (UniqueName: \"kubernetes.io/projected/3234bb8c-b7c8-4df9-965d-08ee7bbda103-kube-api-access-7tt6v\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.220182 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/881f8599-5a39-4754-9b13-dc38915dccbf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.220182 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3234bb8c-b7c8-4df9-965d-08ee7bbda103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.220182 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220154 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7hj\" (UniqueName: \"kubernetes.io/projected/881f8599-5a39-4754-9b13-dc38915dccbf-kube-api-access-tx7hj\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.220347 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxbz\" (UniqueName: \"kubernetes.io/projected/5bfabef7-3e45-4f8b-a324-1b1e6ef818a2-kube-api-access-ttxbz\") pod \"volume-data-source-validator-78dd696465-khtk7\" (UID: \"5bfabef7-3e45-4f8b-a324-1b1e6ef818a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" Jun 11 13:29:37.220347 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.220230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/881f8599-5a39-4754-9b13-dc38915dccbf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.271172 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.271139 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zq4qx"] Jun 11 13:29:37.273103 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.273082 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b48dbbf75-xhbjc"] Jun 11 13:29:37.273230 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.273211 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.274904 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.274887 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.275282 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.275263 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8c92p\"" Jun 11 13:29:37.275357 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.275291 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:29:37.275508 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.275495 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 13:29:37.275679 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.275665 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 13:29:37.275766 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.275671 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 13:29:37.277613 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277579 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 13:29:37.277613 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277602 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mwjkl\"" Jun 11 13:29:37.277809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277652 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 13:29:37.277809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277668 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 13:29:37.277809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 13:29:37.277809 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277776 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 13:29:37.278008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.277963 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 13:29:37.281806 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.281785 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 13:29:37.283887 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.283864 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zq4qx"] Jun 11 13:29:37.289174 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.289145 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b48dbbf75-xhbjc"] Jun 11 13:29:37.320652 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxbz\" (UniqueName: \"kubernetes.io/projected/5bfabef7-3e45-4f8b-a324-1b1e6ef818a2-kube-api-access-ttxbz\") pod \"volume-data-source-validator-78dd696465-khtk7\" (UID: \"5bfabef7-3e45-4f8b-a324-1b1e6ef818a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" Jun 11 13:29:37.320652 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/881f8599-5a39-4754-9b13-dc38915dccbf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.320930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320683 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-trusted-ca\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.320930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320859 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3234bb8c-b7c8-4df9-965d-08ee7bbda103-config\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.320930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-default-certificate\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.320930 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320912 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-stats-auth\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p96sx\" (UniqueName: \"kubernetes.io/projected/26820afc-0c42-4e65-b99e-93f9e5c6ae47-kube-api-access-p96sx\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320966 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.320982 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-serving-cert\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tt6v\" (UniqueName: \"kubernetes.io/projected/3234bb8c-b7c8-4df9-965d-08ee7bbda103-kube-api-access-7tt6v\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321025 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/881f8599-5a39-4754-9b13-dc38915dccbf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-config\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321086 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3234bb8c-b7c8-4df9-965d-08ee7bbda103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7hj\" (UniqueName: \"kubernetes.io/projected/881f8599-5a39-4754-9b13-dc38915dccbf-kube-api-access-tx7hj\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.321151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjphd\" (UniqueName: \"kubernetes.io/projected/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-kube-api-access-kjphd\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.321542 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.321542 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321345 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/881f8599-5a39-4754-9b13-dc38915dccbf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.321542 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.321470 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3234bb8c-b7c8-4df9-965d-08ee7bbda103-config\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.323215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.323187 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/881f8599-5a39-4754-9b13-dc38915dccbf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.323330 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.323313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3234bb8c-b7c8-4df9-965d-08ee7bbda103-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.327259 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.327237 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxbz\" (UniqueName: \"kubernetes.io/projected/5bfabef7-3e45-4f8b-a324-1b1e6ef818a2-kube-api-access-ttxbz\") pod \"volume-data-source-validator-78dd696465-khtk7\" (UID: \"5bfabef7-3e45-4f8b-a324-1b1e6ef818a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" Jun 11 13:29:37.327443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.327423 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tt6v\" (UniqueName: \"kubernetes.io/projected/3234bb8c-b7c8-4df9-965d-08ee7bbda103-kube-api-access-7tt6v\") pod \"service-ca-operator-6bc5ff68f5-4zrkk\" (UID: \"3234bb8c-b7c8-4df9-965d-08ee7bbda103\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.327542 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.327518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7hj\" (UniqueName: \"kubernetes.io/projected/881f8599-5a39-4754-9b13-dc38915dccbf-kube-api-access-tx7hj\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bhrrh\" (UID: \"881f8599-5a39-4754-9b13-dc38915dccbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.391631 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.391600 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:37.421684 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421609 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-trusted-ca\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.421684 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421662 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-default-certificate\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.421684 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-stats-auth\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p96sx\" (UniqueName: \"kubernetes.io/projected/26820afc-0c42-4e65-b99e-93f9e5c6ae47-kube-api-access-p96sx\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421826 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-serving-cert\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-config\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421921 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjphd\" (UniqueName: \"kubernetes.io/projected/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-kube-api-access-kjphd\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.421935 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:37.421961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.421952 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.422305 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.422003 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:37.921981347 +0000 UTC m=+222.720316415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:37.422305 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.422067 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:37.922052532 +0000 UTC m=+222.720387601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:37.422682 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.422655 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-config\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.422792 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.422715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-trusted-ca\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.424146 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.424124 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-serving-cert\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.424252 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.424234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-stats-auth\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.424482 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.424468 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-default-certificate\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.445217 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.445189 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjphd\" (UniqueName: \"kubernetes.io/projected/adccfdb2-c8f2-448a-be0e-68c6d7a047f6-kube-api-access-kjphd\") pod \"console-operator-668fdbf85c-zq4qx\" (UID: \"adccfdb2-c8f2-448a-be0e-68c6d7a047f6\") " pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.445694 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.445680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p96sx\" (UniqueName: \"kubernetes.io/projected/26820afc-0c42-4e65-b99e-93f9e5c6ae47-kube-api-access-p96sx\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.481535 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.481504 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" Jun 11 13:29:37.484468 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.484446 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:37.489541 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.489468 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" Jun 11 13:29:37.495099 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.495080 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" Jun 11 13:29:37.585195 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.585161 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:37.631169 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.631139 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7"] Jun 11 13:29:37.633213 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:29:37.633180 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfabef7_3e45_4f8b_a324_1b1e6ef818a2.slice/crio-3452a0b906f5886a5cc693bacd9ed17cfa5c014238200adb892cf2d8deadd27e WatchSource:0}: Error finding container 3452a0b906f5886a5cc693bacd9ed17cfa5c014238200adb892cf2d8deadd27e: Status 404 returned error can't find the container with id 3452a0b906f5886a5cc693bacd9ed17cfa5c014238200adb892cf2d8deadd27e Jun 11 13:29:37.650117 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.650072 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh"] Jun 11 13:29:37.654917 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:29:37.654885 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881f8599_5a39_4754_9b13_dc38915dccbf.slice/crio-eff4c48c25847bd0a6c2c91c8dd2eb1b99a53e76733ec94fe789be8032efe100 WatchSource:0}: Error finding container eff4c48c25847bd0a6c2c91c8dd2eb1b99a53e76733ec94fe789be8032efe100: Status 404 returned error can't find the container with id eff4c48c25847bd0a6c2c91c8dd2eb1b99a53e76733ec94fe789be8032efe100 Jun 11 13:29:37.723125 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.723094 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-zq4qx"] Jun 11 13:29:37.725857 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:29:37.725834 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadccfdb2_c8f2_448a_be0e_68c6d7a047f6.slice/crio-dd1bf17c573798acf12c08b6a36c4391ed1e6a98214556d7d680c98b586e80c9 WatchSource:0}: Error finding container dd1bf17c573798acf12c08b6a36c4391ed1e6a98214556d7d680c98b586e80c9: Status 404 returned error can't find the container with id dd1bf17c573798acf12c08b6a36c4391ed1e6a98214556d7d680c98b586e80c9 Jun 11 13:29:37.854279 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.854245 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk"] Jun 11 13:29:37.857642 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:29:37.857617 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3234bb8c_b7c8_4df9_965d_08ee7bbda103.slice/crio-645807f78c2392a6866a4ab9df94d6e88db586db13133cb19ec4f7ceaa4b4842 WatchSource:0}: Error finding container 645807f78c2392a6866a4ab9df94d6e88db586db13133cb19ec4f7ceaa4b4842: Status 404 returned error can't find the container with id 645807f78c2392a6866a4ab9df94d6e88db586db13133cb19ec4f7ceaa4b4842 Jun 11 13:29:37.926259 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.926223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.926416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:37.926279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:37.926416 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.926367 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:37.926416 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.926392 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:38.926376556 +0000 UTC m=+223.724711604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:37.926568 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:37.926418 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:38.926405508 +0000 UTC m=+223.724740556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:38.438795 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.438756 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" event={"ID":"881f8599-5a39-4754-9b13-dc38915dccbf","Type":"ContainerStarted","Data":"eff4c48c25847bd0a6c2c91c8dd2eb1b99a53e76733ec94fe789be8032efe100"} Jun 11 13:29:38.440095 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.440039 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" event={"ID":"5bfabef7-3e45-4f8b-a324-1b1e6ef818a2","Type":"ContainerStarted","Data":"3452a0b906f5886a5cc693bacd9ed17cfa5c014238200adb892cf2d8deadd27e"} Jun 11 13:29:38.441491 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.441464 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" event={"ID":"3234bb8c-b7c8-4df9-965d-08ee7bbda103","Type":"ContainerStarted","Data":"645807f78c2392a6866a4ab9df94d6e88db586db13133cb19ec4f7ceaa4b4842"} Jun 11 13:29:38.442704 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.442672 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" event={"ID":"adccfdb2-c8f2-448a-be0e-68c6d7a047f6","Type":"ContainerStarted","Data":"dd1bf17c573798acf12c08b6a36c4391ed1e6a98214556d7d680c98b586e80c9"} Jun 11 13:29:38.933545 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.933516 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:38.933660 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:38.933579 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:38.933727 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:38.933672 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:38.933807 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:38.933756 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:40.933710119 +0000 UTC m=+225.732045168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:38.933807 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:38.933783 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:40.933770192 +0000 UTC m=+225.732105241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:39.446935 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:39.446895 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" event={"ID":"5bfabef7-3e45-4f8b-a324-1b1e6ef818a2","Type":"ContainerStarted","Data":"8268db00d17b467a173f76107744441271582768d2679c1cf200dd14b14e92a0"} Jun 11 13:29:39.462430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:39.462378 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-khtk7" podStartSLOduration=1.190162733 podStartE2EDuration="2.462343292s" totalImagesPullingTime="1.272180559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:29:39.461553606 +0000 UTC m=+224.259888688" watchObservedRunningTime="2026-06-11 13:29:39.462343292 +0000 UTC m=+224.260678395" Jun 11 13:29:39.533659 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:39.533607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:39.631751 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:39.631700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:40.950188 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:40.950166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:40.950519 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:40.950219 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:40.950519 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:40.950316 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:40.950519 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:40.950387 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:44.95036728 +0000 UTC m=+229.748702347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:40.950519 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:40.950412 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:44.950401994 +0000 UTC m=+229.748737042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:41.454050 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.454012 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" event={"ID":"3234bb8c-b7c8-4df9-965d-08ee7bbda103","Type":"ContainerStarted","Data":"eddc5cb7a57052eb9cf3c501951d08bce140e15f05b229ba483c9cb05ffee948"} Jun 11 13:29:41.455638 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.455619 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/0.log" Jun 11 13:29:41.455798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.455650 2552 generic.go:356] "Generic (PLEG): container finished" podID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" containerID="41572e71fd6dce3518ad423a9c7f9b047321ff249d61020f94ce6b8727b9cf1a" exitCode=255 Jun 11 13:29:41.455798 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.455743 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" event={"ID":"adccfdb2-c8f2-448a-be0e-68c6d7a047f6","Type":"ContainerDied","Data":"41572e71fd6dce3518ad423a9c7f9b047321ff249d61020f94ce6b8727b9cf1a"} Jun 11 13:29:41.455966 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.455943 2552 scope.go:117] "RemoveContainer" containerID="41572e71fd6dce3518ad423a9c7f9b047321ff249d61020f94ce6b8727b9cf1a" Jun 11 13:29:41.457489 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.457456 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" event={"ID":"881f8599-5a39-4754-9b13-dc38915dccbf","Type":"ContainerStarted","Data":"7498f88a53af02b09ccc1157c86d14b3f21d307986655324d992dc184b08347d"} Jun 11 13:29:41.472115 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.472068 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" podStartSLOduration=1.393027573 podStartE2EDuration="4.472051712s" totalImagesPullingTime="3.079024139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:29:41.470870505 +0000 UTC m=+226.269205576" watchObservedRunningTime="2026-06-11 13:29:41.472051712 +0000 UTC m=+226.270386784" Jun 11 13:29:41.476804 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.476786 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:41.489554 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.489512 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" podStartSLOduration=1.210635145 podStartE2EDuration="4.489497208s" totalImagesPullingTime="3.278862063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:29:41.488639743 +0000 UTC m=+226.286974813" watchObservedRunningTime="2026-06-11 13:29:41.489497208 +0000 UTC m=+226.287832279" Jun 11 13:29:41.584900 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:41.584870 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.126483 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.126450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.225197 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.225115 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z"] Jun 11 13:29:42.226085 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.226061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.228221 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.228206 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" Jun 11 13:29:42.230177 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.230156 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qv7g2\"" Jun 11 13:29:42.230177 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.230163 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 13:29:42.230982 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.230964 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 13:29:42.234642 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.234621 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z"] Jun 11 13:29:42.278513 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.278483 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.361853 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.361823 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqrf\" (UniqueName: \"kubernetes.io/projected/a96ac9d8-341e-480a-a2df-16544eab8697-kube-api-access-lsqrf\") pod \"migrator-955ffdf5f-vfh7z\" (UID: \"a96ac9d8-341e-480a-a2df-16544eab8697\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" Jun 11 13:29:42.379135 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.379109 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.462247 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.462216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqrf\" (UniqueName: \"kubernetes.io/projected/a96ac9d8-341e-480a-a2df-16544eab8697-kube-api-access-lsqrf\") pod \"migrator-955ffdf5f-vfh7z\" (UID: \"a96ac9d8-341e-480a-a2df-16544eab8697\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" Jun 11 13:29:42.462683 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.462666 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/1.log" Jun 11 13:29:42.463098 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.463084 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/0.log" Jun 11 13:29:42.463142 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.463116 2552 generic.go:356] "Generic (PLEG): container finished" podID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" exitCode=255 Jun 11 13:29:42.463194 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.463181 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" event={"ID":"adccfdb2-c8f2-448a-be0e-68c6d7a047f6","Type":"ContainerDied","Data":"ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a"} Jun 11 13:29:42.463242 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.463228 2552 scope.go:117] "RemoveContainer" containerID="41572e71fd6dce3518ad423a9c7f9b047321ff249d61020f94ce6b8727b9cf1a" Jun 11 13:29:42.463472 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.463450 2552 scope.go:117] "RemoveContainer" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" Jun 11 13:29:42.463648 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:42.463625 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:29:42.470805 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.470781 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqrf\" (UniqueName: \"kubernetes.io/projected/a96ac9d8-341e-480a-a2df-16544eab8697-kube-api-access-lsqrf\") pod \"migrator-955ffdf5f-vfh7z\" (UID: \"a96ac9d8-341e-480a-a2df-16544eab8697\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" Jun 11 13:29:42.538339 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.538315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" Jun 11 13:29:42.660551 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.660520 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z"] Jun 11 13:29:42.663722 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:29:42.663693 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96ac9d8_341e_480a_a2df_16544eab8697.slice/crio-10d5a936f67fb8877de5491d2db0abdee8d47d01e2c1f13bdbf29a9aa6113eb5 WatchSource:0}: Error finding container 10d5a936f67fb8877de5491d2db0abdee8d47d01e2c1f13bdbf29a9aa6113eb5: Status 404 returned error can't find the container with id 10d5a936f67fb8877de5491d2db0abdee8d47d01e2c1f13bdbf29a9aa6113eb5 Jun 11 13:29:42.821013 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.820939 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:42.924347 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:42.924320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:43.392206 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:43.392177 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k8ptl_4a2c218c-6182-41b8-9594-b025d0106ea7/dns-node-resolver/0.log" Jun 11 13:29:43.468585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:43.468553 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/1.log" Jun 11 13:29:43.469006 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:43.468956 2552 scope.go:117] "RemoveContainer" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" Jun 11 13:29:43.469168 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:43.469140 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:29:43.470060 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:43.470035 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" event={"ID":"a96ac9d8-341e-480a-a2df-16544eab8697","Type":"ContainerStarted","Data":"10d5a936f67fb8877de5491d2db0abdee8d47d01e2c1f13bdbf29a9aa6113eb5"} Jun 11 13:29:44.393282 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.393259 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbjrd_603a79c1-ffea-470f-a6a6-e371e95c912b/node-ca/0.log" Jun 11 13:29:44.468345 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.468297 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:44.473845 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.473819 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" event={"ID":"a96ac9d8-341e-480a-a2df-16544eab8697","Type":"ContainerStarted","Data":"c61bcf8b934a245997aed925cd37e8aaa861d31d7459d5bfe8c82a7d7da6f6db"} Jun 11 13:29:44.473977 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.473871 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" event={"ID":"a96ac9d8-341e-480a-a2df-16544eab8697","Type":"ContainerStarted","Data":"6165b1a5c57cc4aebd7e9ac669e11f75f9e6867838df46ea914a3d1f95e06bdc"} Jun 11 13:29:44.487177 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.487034 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vfh7z" podStartSLOduration=1.276633128 podStartE2EDuration="2.48701672s" totalImagesPullingTime="1.210383592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:29:44.48689662 +0000 UTC m=+229.285231693" watchObservedRunningTime="2026-06-11 13:29:44.48701672 +0000 UTC m=+229.285351789" Jun 11 13:29:44.523919 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.523884 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:44.624404 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.624371 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:44.985139 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.985102 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:44.985310 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.985150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:44.985310 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:44.985251 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:44.985310 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:44.985285 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:52.985272529 +0000 UTC m=+237.783607577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:44.985310 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:44.985302 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:52.98529495 +0000 UTC m=+237.783629998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:44.991937 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:44.991918 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49krr_acc1b6fd-fdba-4a4d-b064-a4923203db5e/serve-healthcheck-canary/0.log" Jun 11 13:29:45.347788 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:45.347748 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:47.585444 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:47.585415 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:47.585847 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:47.585470 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:29:47.585847 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:47.585816 2552 scope.go:117] "RemoveContainer" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" Jun 11 13:29:47.585978 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:47.585959 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:29:47.898013 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:47.897910 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.370205 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.370171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.512913 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.512882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.667226 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.667146 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.756230 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.756202 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.856570 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.856542 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:49.957156 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:49.957084 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:50.056968 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:50.056937 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:51.025481 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:51.025448 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:51.137304 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:51.137270 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:51.428430 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:51.428336 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:51.628447 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:51.628405 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:51.822150 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:51.822120 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:52.222520 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:52.222444 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:52.823712 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:52.823679 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:53.049154 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.049123 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:53.049306 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.049167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:29:53.049349 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:53.049305 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:29:53.049380 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:53.049371 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:09.049356612 +0000 UTC m=+253.847691679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : secret "router-metrics-certs-default" not found Jun 11 13:29:53.049422 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:29:53.049395 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle podName:26820afc-0c42-4e65-b99e-93f9e5c6ae47 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:09.04937871 +0000 UTC m=+253.847713758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle") pod "router-default-6b48dbbf75-xhbjc" (UID: "26820afc-0c42-4e65-b99e-93f9e5c6ae47") : configmap references non-existent config key: service-ca.crt Jun 11 13:29:53.233468 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.233386 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:53.299478 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.299444 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:53.430324 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.430288 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:53.623692 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.623667 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:53.823721 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:53.823693 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:54.230038 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:54.230009 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:54.529270 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:54.529241 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:54.843579 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:54.843494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:55.427375 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:55.427343 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:55.630506 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:55.630474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:55.826964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:55.826929 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:55.900849 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:55.900822 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:56.226599 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:56.226519 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:57.176967 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:57.176935 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:57.429622 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:57.429540 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:57.629205 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:57.629172 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:57.826566 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:57.826537 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:58.031416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:58.031387 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:59.227428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:59.227392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:59.431425 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:59.431395 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:59.624503 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:59.624469 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:29:59.825376 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:29:59.825348 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:00.027121 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:00.027089 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:01.291571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:01.291538 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:01.353340 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:01.353313 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:01.634253 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:01.634181 2552 scope.go:117] "RemoveContainer" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" Jun 11 13:30:02.528835 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.528811 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:02.529189 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.529174 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/1.log" Jun 11 13:30:02.529226 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.529207 2552 generic.go:356] "Generic (PLEG): container finished" podID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" containerID="41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441" exitCode=255 Jun 11 13:30:02.529278 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.529258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" event={"ID":"adccfdb2-c8f2-448a-be0e-68c6d7a047f6","Type":"ContainerDied","Data":"41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441"} Jun 11 13:30:02.529318 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.529300 2552 scope.go:117] "RemoveContainer" containerID="ef1b6c759ecca17697f90f5173e9ef58d1f28bdcb0afd16b1b05ec31f392107a" Jun 11 13:30:02.529581 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:02.529559 2552 scope.go:117] "RemoveContainer" containerID="41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441" Jun 11 13:30:02.529780 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:02.529728 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:30:03.533564 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:03.533537 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:04.314230 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:04.314196 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:04.415057 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:04.415024 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:06.448609 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.448573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:30:06.450842 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.450821 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb-metrics-certs\") pod \"network-metrics-daemon-5d9lx\" (UID: \"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb\") " pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:30:06.739416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.739343 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fzt5j\"" Jun 11 13:30:06.744558 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.744541 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d9lx" Jun 11 13:30:06.820726 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.820695 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vrxms"] Jun 11 13:30:06.824178 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.824160 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.826858 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.826131 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 13:30:06.826858 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.826487 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 13:30:06.827071 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.826973 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p9xwf\"" Jun 11 13:30:06.827071 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.827056 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 13:30:06.827363 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.827197 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 13:30:06.832408 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.832328 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vrxms"] Jun 11 13:30:06.853053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.853027 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:06.877033 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.876998 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5d9lx"] Jun 11 13:30:06.880267 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:06.880243 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2e9f9b_fc44_4dbb_ba3b_e25546d9a4cb.slice/crio-9419dfa1a18262cde32884135f530057c1d074e06f38cf510624aaf74b66c321 WatchSource:0}: Error finding container 9419dfa1a18262cde32884135f530057c1d074e06f38cf510624aaf74b66c321: Status 404 returned error can't find the container with id 9419dfa1a18262cde32884135f530057c1d074e06f38cf510624aaf74b66c321 Jun 11 13:30:06.952435 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.952401 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q545l\" (UniqueName: \"kubernetes.io/projected/cec4844d-a181-4423-b7c0-e23aac05be80-kube-api-access-q545l\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.952592 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.952456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec4844d-a181-4423-b7c0-e23aac05be80-data-volume\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.952592 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.952532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec4844d-a181-4423-b7c0-e23aac05be80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.952592 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.952561 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec4844d-a181-4423-b7c0-e23aac05be80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.952708 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.952615 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec4844d-a181-4423-b7c0-e23aac05be80-crio-socket\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:06.953752 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:06.953708 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:07.053022 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.052993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec4844d-a181-4423-b7c0-e23aac05be80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053022 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053021 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec4844d-a181-4423-b7c0-e23aac05be80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053022 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053021 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:07.053299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053055 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec4844d-a181-4423-b7c0-e23aac05be80-crio-socket\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053107 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q545l\" (UniqueName: \"kubernetes.io/projected/cec4844d-a181-4423-b7c0-e23aac05be80-kube-api-access-q545l\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec4844d-a181-4423-b7c0-e23aac05be80-data-volume\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053202 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec4844d-a181-4423-b7c0-e23aac05be80-crio-socket\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053508 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053487 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec4844d-a181-4423-b7c0-e23aac05be80-data-volume\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.053621 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.053605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec4844d-a181-4423-b7c0-e23aac05be80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.055255 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.055234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec4844d-a181-4423-b7c0-e23aac05be80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.060298 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.060276 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q545l\" (UniqueName: \"kubernetes.io/projected/cec4844d-a181-4423-b7c0-e23aac05be80-kube-api-access-q545l\") pod \"insights-runtime-extractor-vrxms\" (UID: \"cec4844d-a181-4423-b7c0-e23aac05be80\") " pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.136891 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.136856 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vrxms" Jun 11 13:30:07.263679 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.263646 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vrxms"] Jun 11 13:30:07.267318 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:07.267290 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec4844d_a181_4423_b7c0_e23aac05be80.slice/crio-a694bc7e44bda76a20d1303ecbb6f3d0ceee5ae92ed509cb0573fdea6860ff67 WatchSource:0}: Error finding container a694bc7e44bda76a20d1303ecbb6f3d0ceee5ae92ed509cb0573fdea6860ff67: Status 404 returned error can't find the container with id a694bc7e44bda76a20d1303ecbb6f3d0ceee5ae92ed509cb0573fdea6860ff67 Jun 11 13:30:07.546411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.546372 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrxms" event={"ID":"cec4844d-a181-4423-b7c0-e23aac05be80","Type":"ContainerStarted","Data":"9a7606968b23aa11e69691a6c8ab1a1eeca21d53e7c257ddc4e38322938b99e5"} Jun 11 13:30:07.546856 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.546437 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrxms" event={"ID":"cec4844d-a181-4423-b7c0-e23aac05be80","Type":"ContainerStarted","Data":"a694bc7e44bda76a20d1303ecbb6f3d0ceee5ae92ed509cb0573fdea6860ff67"} Jun 11 13:30:07.547624 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.547598 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d9lx" event={"ID":"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb","Type":"ContainerStarted","Data":"9419dfa1a18262cde32884135f530057c1d074e06f38cf510624aaf74b66c321"} Jun 11 13:30:07.585586 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.585501 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:30:07.585586 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.585565 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:30:07.585943 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:07.585926 2552 scope.go:117] "RemoveContainer" containerID="41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441" Jun 11 13:30:07.586116 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:07.586097 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:30:08.552952 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.552910 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrxms" event={"ID":"cec4844d-a181-4423-b7c0-e23aac05be80","Type":"ContainerStarted","Data":"46980cc1ae95f3b904beb5bd01d06697cb0c94881a38c97d3d7be7805c40e0f0"} Jun 11 13:30:08.554842 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.554817 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d9lx" event={"ID":"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb","Type":"ContainerStarted","Data":"2e47c45b3c1f287c8631964522e48ac7b6f5b7b567d4c5fe2795c147a0407684"} Jun 11 13:30:08.554979 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.554871 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d9lx" event={"ID":"6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb","Type":"ContainerStarted","Data":"299ce690a4250fa2c4d926675abc2142b031c8457ca44f740aa391013dd79c9b"} Jun 11 13:30:08.570119 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.570047 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5d9lx" podStartSLOduration=252.693823401 podStartE2EDuration="4m13.570031782s" totalImagesPullingTime="876.208381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:08.568503441 +0000 UTC m=+253.366838511" watchObservedRunningTime="2026-06-11 13:30:08.570031782 +0000 UTC m=+253.368366851" Jun 11 13:30:08.652126 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.652099 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:08.708888 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:08.708850 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:09.068153 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.068113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:09.068343 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.068221 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:09.068973 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.068941 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26820afc-0c42-4e65-b99e-93f9e5c6ae47-service-ca-bundle\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:09.070892 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.070861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26820afc-0c42-4e65-b99e-93f9e5c6ae47-metrics-certs\") pod \"router-default-6b48dbbf75-xhbjc\" (UID: \"26820afc-0c42-4e65-b99e-93f9e5c6ae47\") " pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:09.092859 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.092832 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mwjkl\"" Jun 11 13:30:09.101455 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.101434 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:09.239095 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:09.239062 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b48dbbf75-xhbjc"] Jun 11 13:30:09.648699 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:09.648667 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26820afc_0c42_4e65_b99e_93f9e5c6ae47.slice/crio-e49da3fbdca9f0cf9b3453ebd59475a13d0fdee490da4fe61a42a50af13cf94a WatchSource:0}: Error finding container e49da3fbdca9f0cf9b3453ebd59475a13d0fdee490da4fe61a42a50af13cf94a: Status 404 returned error can't find the container with id e49da3fbdca9f0cf9b3453ebd59475a13d0fdee490da4fe61a42a50af13cf94a Jun 11 13:30:10.563086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:10.563046 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vrxms" event={"ID":"cec4844d-a181-4423-b7c0-e23aac05be80","Type":"ContainerStarted","Data":"3124a7a5acd3205f60e5f78ab769f1340c9bd843c64e22b5d0524a072c49c063"} Jun 11 13:30:10.564349 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:10.564321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" event={"ID":"26820afc-0c42-4e65-b99e-93f9e5c6ae47","Type":"ContainerStarted","Data":"e7a8a981642ecf05dc7956a48dd1339d708d8bf2a86b766757d306f011a46951"} Jun 11 13:30:10.564487 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:10.564360 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" event={"ID":"26820afc-0c42-4e65-b99e-93f9e5c6ae47","Type":"ContainerStarted","Data":"e49da3fbdca9f0cf9b3453ebd59475a13d0fdee490da4fe61a42a50af13cf94a"} Jun 11 13:30:10.582987 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:10.582944 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vrxms" podStartSLOduration=2.282439319 podStartE2EDuration="4.58293008s" totalImagesPullingTime="2.300490761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:30:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:10.582171421 +0000 UTC m=+255.380506502" watchObservedRunningTime="2026-06-11 13:30:10.58293008 +0000 UTC m=+255.381265147" Jun 11 13:30:10.599857 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:10.599810 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" podStartSLOduration=33.599796204 podStartE2EDuration="33.599796204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:10.598949661 +0000 UTC m=+255.397284730" watchObservedRunningTime="2026-06-11 13:30:10.599796204 +0000 UTC m=+255.398131273" Jun 11 13:30:11.102054 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:11.102022 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:11.104618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:11.104594 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:11.568816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:11.568784 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:11.569938 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:11.569914 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b48dbbf75-xhbjc" Jun 11 13:30:11.982145 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:11.982013 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:12.080026 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.079990 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:12.141877 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.141837 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf"] Jun 11 13:30:12.142258 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.141997 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:12.144819 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.144804 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:12.146574 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.146556 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 13:30:12.146682 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.146606 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v489m\"" Jun 11 13:30:12.151889 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.151866 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf"] Jun 11 13:30:12.189530 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.189498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f5tpf\" (UID: \"2d53d19d-7396-4500-982f-5786d6383c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:12.290337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.290308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f5tpf\" (UID: \"2d53d19d-7396-4500-982f-5786d6383c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:12.290463 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:12.290415 2552 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 13:30:12.290505 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:12.290468 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates podName:2d53d19d-7396-4500-982f-5786d6383c69 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:12.79045238 +0000 UTC m=+257.588787433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-f5tpf" (UID: "2d53d19d-7396-4500-982f-5786d6383c69") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 13:30:12.340173 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.340137 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:12.794036 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.794001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f5tpf\" (UID: \"2d53d19d-7396-4500-982f-5786d6383c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:12.800449 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:12.796718 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d53d19d-7396-4500-982f-5786d6383c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f5tpf\" (UID: \"2d53d19d-7396-4500-982f-5786d6383c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:13.054681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:13.054590 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:13.079299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:13.079268 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:13.176992 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:13.176960 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf"] Jun 11 13:30:13.180382 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:13.180348 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d53d19d_7396_4500_982f_5786d6383c69.slice/crio-c0ee4f64f60a34fa04909c14b5f108a8b933c68d296cf68adbe1e99a03096f5d WatchSource:0}: Error finding container c0ee4f64f60a34fa04909c14b5f108a8b933c68d296cf68adbe1e99a03096f5d: Status 404 returned error can't find the container with id c0ee4f64f60a34fa04909c14b5f108a8b933c68d296cf68adbe1e99a03096f5d Jun 11 13:30:13.180574 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:13.180532 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:13.575630 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:13.575590 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" event={"ID":"2d53d19d-7396-4500-982f-5786d6383c69","Type":"ContainerStarted","Data":"c0ee4f64f60a34fa04909c14b5f108a8b933c68d296cf68adbe1e99a03096f5d"} Jun 11 13:30:15.584677 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:15.584637 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" event={"ID":"2d53d19d-7396-4500-982f-5786d6383c69","Type":"ContainerStarted","Data":"442b97b15fe650204783d9c4b6233467ce483a665665799973b12d13413a70a8"} Jun 11 13:30:15.585087 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:15.584843 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:15.589994 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:15.589970 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" Jun 11 13:30:15.598773 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:15.598712 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f5tpf" podStartSLOduration=2.24811131 podStartE2EDuration="3.598700047s" totalImagesPullingTime="1.350588737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:15.597781875 +0000 UTC m=+260.396116941" watchObservedRunningTime="2026-06-11 13:30:15.598700047 +0000 UTC m=+260.397035117" Jun 11 13:30:16.163898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:16.163865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:16.227508 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:16.227474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:17.129743 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:17.129707 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:19.587321 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:19.587292 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.288549 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.288517 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.494986 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.494954 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.549879 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.549805 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7"] Jun 11 13:30:21.552303 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.552285 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.554824 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.554806 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 13:30:21.554936 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.554864 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 13:30:21.555543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.555524 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gnxtk\"" Jun 11 13:30:21.555649 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.555524 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 13:30:21.555649 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.555621 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 13:30:21.556980 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.556965 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 13:30:21.562659 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.562638 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n"] Jun 11 13:30:21.564505 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.564491 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.565053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.565035 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7"] Jun 11 13:30:21.566502 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.566480 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 13:30:21.566603 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.566529 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sj5q6\"" Jun 11 13:30:21.566668 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.566521 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 13:30:21.566937 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.566915 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 13:30:21.577070 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.577049 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k6djl"] Jun 11 13:30:21.579156 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.579139 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.580082 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.580065 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n"] Jun 11 13:30:21.580894 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.580873 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 13:30:21.580988 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.580915 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 13:30:21.580988 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.580921 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-grptq\"" Jun 11 13:30:21.581199 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.581184 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 13:30:21.582898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.582878 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.634324 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.634300 2552 scope.go:117] "RemoveContainer" containerID="41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441" Jun 11 13:30:21.634492 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:21.634459 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-zq4qx_openshift-console-operator(adccfdb2-c8f2-448a-be0e-68c6d7a047f6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podUID="adccfdb2-c8f2-448a-be0e-68c6d7a047f6" Jun 11 13:30:21.649339 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.649301 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.658373 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658346 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.658474 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.658474 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.658474 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245dt\" (UniqueName: \"kubernetes.io/projected/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-kube-api-access-245dt\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.658575 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658470 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.658575 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bzms\" (UniqueName: \"kubernetes.io/projected/4af201b7-b5ec-4a48-a144-14704ddeff20-kube-api-access-6bzms\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.658689 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658671 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-tls\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.658723 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658712 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.658786 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.658786 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658776 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-textfile\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.658851 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.658919 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtv98\" (UniqueName: \"kubernetes.io/projected/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-api-access-qtv98\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.658954 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658943 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.658990 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658969 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-wtmp\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.659025 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.658989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-root\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.659025 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.659005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.659083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.659050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-sys\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.659112 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.659080 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.659253 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.659234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-metrics-client-ca\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.749941 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.749897 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.760008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.759979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtv98\" (UniqueName: \"kubernetes.io/projected/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-api-access-qtv98\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-wtmp\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760081 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-root\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760108 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-sys\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.760168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760162 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-metrics-client-ca\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245dt\" (UniqueName: \"kubernetes.io/projected/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-kube-api-access-245dt\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.760464 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760321 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761012 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.760990 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-root\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761189 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.761374 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.761443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761371 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-sys\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-wtmp\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761443 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761289 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.761638 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761620 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bzms\" (UniqueName: \"kubernetes.io/projected/4af201b7-b5ec-4a48-a144-14704ddeff20-kube-api-access-6bzms\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761771 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761688 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-metrics-client-ca\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761845 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761749 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-tls\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761845 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761818 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.761950 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.761950 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-textfile\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.761950 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.761930 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.762166 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.762142 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.762832 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.762806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-textfile\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.763016 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.762993 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.763114 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.763051 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.764036 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.764012 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.764146 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.764125 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.764896 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.764872 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4af201b7-b5ec-4a48-a144-14704ddeff20-node-exporter-tls\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.765259 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.765227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.765411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.765392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.766782 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.766764 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtv98\" (UniqueName: \"kubernetes.io/projected/c66b7040-da6d-4e35-9753-a2ab4f6dcc6c-kube-api-access-qtv98\") pod \"kube-state-metrics-57bbf8bfb5-47v6n\" (UID: \"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.767175 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.767158 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-245dt\" (UniqueName: \"kubernetes.io/projected/a8b69c7f-5fd1-4fd8-9996-0baacada18eb-kube-api-access-245dt\") pod \"openshift-state-metrics-65f78d5c66-t9fh7\" (UID: \"a8b69c7f-5fd1-4fd8-9996-0baacada18eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.767963 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.767945 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bzms\" (UniqueName: \"kubernetes.io/projected/4af201b7-b5ec-4a48-a144-14704ddeff20-kube-api-access-6bzms\") pod \"node-exporter-k6djl\" (UID: \"4af201b7-b5ec-4a48-a144-14704ddeff20\") " pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.850870 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.850788 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:21.861453 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.861438 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" Jun 11 13:30:21.873039 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.873017 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" Jun 11 13:30:21.888369 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.888335 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6djl" Jun 11 13:30:21.899922 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:21.899888 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af201b7_b5ec_4a48_a144_14704ddeff20.slice/crio-cd61f6887a0226c8650aa3718173f7c6c121737d9a22b3a074e05bac7464d0af WatchSource:0}: Error finding container cd61f6887a0226c8650aa3718173f7c6c121737d9a22b3a074e05bac7464d0af: Status 404 returned error can't find the container with id cd61f6887a0226c8650aa3718173f7c6c121737d9a22b3a074e05bac7464d0af Jun 11 13:30:21.951662 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:21.951539 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:22.000857 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.000833 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7"] Jun 11 13:30:22.003131 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:22.003101 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b69c7f_5fd1_4fd8_9996_0baacada18eb.slice/crio-3d73816eebfff90cafc4e907be2b47f0a0ac420d10412d9b4254c5ce6c359a46 WatchSource:0}: Error finding container 3d73816eebfff90cafc4e907be2b47f0a0ac420d10412d9b4254c5ce6c359a46: Status 404 returned error can't find the container with id 3d73816eebfff90cafc4e907be2b47f0a0ac420d10412d9b4254c5ce6c359a46 Jun 11 13:30:22.017322 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.017295 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n"] Jun 11 13:30:22.022604 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:22.022569 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66b7040_da6d_4e35_9753_a2ab4f6dcc6c.slice/crio-bcd3fd540e63342467963d37dac14ac6c806c7f464c2ff530d3a775c4ef3b878 WatchSource:0}: Error finding container bcd3fd540e63342467963d37dac14ac6c806c7f464c2ff530d3a775c4ef3b878: Status 404 returned error can't find the container with id bcd3fd540e63342467963d37dac14ac6c806c7f464c2ff530d3a775c4ef3b878 Jun 11 13:30:22.522251 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.522158 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:22.596086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.596052 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:22.600247 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.600212 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:30:22.602942 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.602923 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.605202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605002 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q2smw\"" Jun 11 13:30:22.605307 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605215 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 13:30:22.605307 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605282 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 13:30:22.605423 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605310 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 13:30:22.605423 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605398 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 13:30:22.605612 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605548 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 13:30:22.605801 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605772 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 13:30:22.605879 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605821 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 13:30:22.605938 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605896 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 13:30:22.605987 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.605955 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 13:30:22.609724 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.609703 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6djl" event={"ID":"4af201b7-b5ec-4a48-a144-14704ddeff20","Type":"ContainerStarted","Data":"cd61f6887a0226c8650aa3718173f7c6c121737d9a22b3a074e05bac7464d0af"} Jun 11 13:30:22.613563 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.613307 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" event={"ID":"a8b69c7f-5fd1-4fd8-9996-0baacada18eb","Type":"ContainerStarted","Data":"879e63ed1a0d53ab4c9308d4331c8081a659fc272674cf15b68b3ebf6bd343a7"} Jun 11 13:30:22.613563 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.613401 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" event={"ID":"a8b69c7f-5fd1-4fd8-9996-0baacada18eb","Type":"ContainerStarted","Data":"9c3b8092c582738423cd83101d3432dcbef789778284fed98623a201cdc4b009"} Jun 11 13:30:22.613563 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.613439 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" event={"ID":"a8b69c7f-5fd1-4fd8-9996-0baacada18eb","Type":"ContainerStarted","Data":"3d73816eebfff90cafc4e907be2b47f0a0ac420d10412d9b4254c5ce6c359a46"} Jun 11 13:30:22.616840 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.616807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" event={"ID":"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c","Type":"ContainerStarted","Data":"bcd3fd540e63342467963d37dac14ac6c806c7f464c2ff530d3a775c4ef3b878"} Jun 11 13:30:22.619350 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.619327 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:30:22.667823 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.667788 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.667984 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.667840 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.667984 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.667863 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.667984 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.667881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.667984 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.667907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq69k\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668196 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668010 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668196 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668196 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668196 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668154 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668399 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668197 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668399 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668399 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668251 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.668399 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.668305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.735485 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.735422 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769703 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769872 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769945 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.769970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770098 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.770230 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq69k\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.771264 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.771600 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:22.771575 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle podName:b9ca9540-33a5-4fca-8fef-64636f4bc407 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:23.271551419 +0000 UTC m=+268.069886481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407") : configmap references non-existent config key: ca-bundle.crt Jun 11 13:30:22.773418 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.773393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.778232 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.778150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.778232 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.778187 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.779507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.778743 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.779664 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.779608 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.779664 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.779606 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.779886 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.779866 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.780017 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.779999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.780416 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.780323 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.780519 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.780505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:22.782526 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:22.782482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq69k\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:23.276076 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.276045 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:23.276843 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.276820 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:23.516686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.516654 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:30:23.622940 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.622851 2552 generic.go:356] "Generic (PLEG): container finished" podID="4af201b7-b5ec-4a48-a144-14704ddeff20" containerID="5cd0cac1a789d1e80b60d0e3c41b215ba838c4278eecd7fc9f66404a78fece0f" exitCode=0 Jun 11 13:30:23.623389 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.622946 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6djl" event={"ID":"4af201b7-b5ec-4a48-a144-14704ddeff20","Type":"ContainerDied","Data":"5cd0cac1a789d1e80b60d0e3c41b215ba838c4278eecd7fc9f66404a78fece0f"} Jun 11 13:30:23.625688 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.625651 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" event={"ID":"a8b69c7f-5fd1-4fd8-9996-0baacada18eb","Type":"ContainerStarted","Data":"ebdfdd5943f716de2b1a13afab2e924df09dcfbc6e9e5b8628bef645a62f5bde"} Jun 11 13:30:23.656884 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.656827 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-t9fh7" podStartSLOduration=1.508136379 podStartE2EDuration="2.65680582s" totalImagesPullingTime="1.148669441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:23.655481063 +0000 UTC m=+268.453816135" watchObservedRunningTime="2026-06-11 13:30:23.65680582 +0000 UTC m=+268.455140892" Jun 11 13:30:23.891592 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:23.891560 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:30:23.895365 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:23.895333 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ca9540_33a5_4fca_8fef_64636f4bc407.slice/crio-45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d WatchSource:0}: Error finding container 45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d: Status 404 returned error can't find the container with id 45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d Jun 11 13:30:24.449175 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.449144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:24.527149 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.525921 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:24.527149 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.526255 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299"] Jun 11 13:30:24.530712 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.530687 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.533436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533408 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 13:30:24.533436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533455 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 13:30:24.533436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 13:30:24.533863 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533412 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dfgsq\"" Jun 11 13:30:24.533863 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533406 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 13:30:24.533863 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533412 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 13:30:24.533863 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.533697 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4ocq7aoup225i\"" Jun 11 13:30:24.540362 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.540203 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299"] Jun 11 13:30:24.578125 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.578094 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:24.587229 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587369 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-metrics-client-ca\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587369 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-grpc-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587369 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587293 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587473 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587381 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587473 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587535 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.587535 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.587518 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qkg\" (UniqueName: \"kubernetes.io/projected/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-kube-api-access-h5qkg\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.635371 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.635330 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:24.636804 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.636772 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6djl" event={"ID":"4af201b7-b5ec-4a48-a144-14704ddeff20","Type":"ContainerStarted","Data":"7aafb382c30d18126ed6268a356deddfbc9c365db269fc97e0fe4b81dce9594b"} Jun 11 13:30:24.636916 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.636867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6djl" event={"ID":"4af201b7-b5ec-4a48-a144-14704ddeff20","Type":"ContainerStarted","Data":"e65091d8e59edca78cc6bc196299456c4979086be9021294757bc189dfeb4ece"} Jun 11 13:30:24.639079 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.639054 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" event={"ID":"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c","Type":"ContainerStarted","Data":"ae016f6ff3a5fd17d8fe89880aaa827ce94ba90772f3052e0fafa28cb6bb7a13"} Jun 11 13:30:24.639202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.639102 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" event={"ID":"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c","Type":"ContainerStarted","Data":"6c9d1439d67417c3e80516f3851c232f02e9d8419118b0fcf71f6cc21ae2b122"} Jun 11 13:30:24.639202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.639122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" event={"ID":"c66b7040-da6d-4e35-9753-a2ab4f6dcc6c","Type":"ContainerStarted","Data":"3ed9ab7eff5ba803e6f254b3e106737392b069ddc0059ab95baecaa70c1305d4"} Jun 11 13:30:24.640439 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.640414 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d"} Jun 11 13:30:24.653586 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.653539 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k6djl" podStartSLOduration=2.5919454650000002 podStartE2EDuration="3.653520827s" totalImagesPullingTime="988.584135ms" totalInitContainerRuntime="72.991227ms" isStatefulPod=true podCreationTimestamp="2026-06-11 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:24.652169564 +0000 UTC m=+269.450504645" watchObservedRunningTime="2026-06-11 13:30:24.653520827 +0000 UTC m=+269.451855874" Jun 11 13:30:24.669590 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.669537 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-47v6n" podStartSLOduration=1.890184707 podStartE2EDuration="3.669517155s" totalImagesPullingTime="1.779332448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:24.667970592 +0000 UTC m=+269.466305688" watchObservedRunningTime="2026-06-11 13:30:24.669517155 +0000 UTC m=+269.467852228" Jun 11 13:30:24.688788 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.688750 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-metrics-client-ca\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.688964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.688797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-grpc-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.689071 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689043 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689364 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qkg\" (UniqueName: \"kubernetes.io/projected/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-kube-api-access-h5qkg\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689445 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.690035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.689837 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-metrics-client-ca\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.692275 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692247 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.692275 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692260 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.692442 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692292 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-grpc-tls\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.692684 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692657 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.692914 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692881 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.693004 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.692970 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.696615 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.696585 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qkg\" (UniqueName: \"kubernetes.io/projected/c7a5d293-f3d5-4247-92ec-6cc2da8e07c1-kube-api-access-h5qkg\") pod \"thanos-querier-6ffdfcdbc7-8s299\" (UID: \"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1\") " pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:24.843851 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:24.843808 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:25.095203 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:25.095111 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299"] Jun 11 13:30:25.153658 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:25.153622 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a5d293_f3d5_4247_92ec_6cc2da8e07c1.slice/crio-73cfc52e18a2f41bdb44cc58fde9c424930212bfd1504c491e60bd829d452ec0 WatchSource:0}: Error finding container 73cfc52e18a2f41bdb44cc58fde9c424930212bfd1504c491e60bd829d452ec0: Status 404 returned error can't find the container with id 73cfc52e18a2f41bdb44cc58fde9c424930212bfd1504c491e60bd829d452ec0 Jun 11 13:30:25.645024 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:25.644991 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="87a14b9ca23dc4be65130a704363503c73ff455d3b0c262181f249ed8aff135c" exitCode=0 Jun 11 13:30:25.645492 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:25.645059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"87a14b9ca23dc4be65130a704363503c73ff455d3b0c262181f249ed8aff135c"} Jun 11 13:30:25.646146 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:25.646127 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"73cfc52e18a2f41bdb44cc58fde9c424930212bfd1504c491e60bd829d452ec0"} Jun 11 13:30:26.336143 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:26.336104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:26.690782 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:26.690685 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:27.714718 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.714688 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:30:27.715278 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.715253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:27.720153 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.720133 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.722247 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722227 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 13:30:27.722343 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722302 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a743hee29ofni\"" Jun 11 13:30:27.722633 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722617 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 13:30:27.722633 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722626 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 13:30:27.722775 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722660 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 13:30:27.722775 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.722619 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 13:30:27.723377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723013 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 13:30:27.723377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723027 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 13:30:27.723377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723057 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 13:30:27.723377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723124 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 13:30:27.723377 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723306 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 13:30:27.723934 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723464 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 13:30:27.723934 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723469 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 13:30:27.723934 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.723506 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 13:30:27.724163 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.724097 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-86s59\"" Jun 11 13:30:27.726482 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.726428 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 13:30:27.728859 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.728840 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 13:30:27.733227 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.733205 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:30:27.818954 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.818921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819080 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.818990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819080 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819080 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819152 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819187 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819345 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmgr\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819386 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819504 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.819898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.819558 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmgr\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920176 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920205 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920261 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920289 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920436 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.920878 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920601 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.922110 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920625 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.922110 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920662 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.922110 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.920710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.922110 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.921633 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.922324 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.922149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.922388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.922715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.922904 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.923491 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.923600 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.923704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924215 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.924081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924635 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.924241 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924635 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.924489 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.924946 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.924913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.926015 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.925970 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.926187 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.926164 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.926269 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.926200 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.926865 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.926844 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.926963 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.926871 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.927096 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.927076 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.927959 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.927941 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:27.930402 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:27.930381 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmgr\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr\") pod \"prometheus-k8s-0\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:28.041066 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.041031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:28.180072 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.179996 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:30:28.183270 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:28.183243 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9c832b_cc9c_48f0_8053_3536b185ddcb.slice/crio-e2966c375a0a178afb1e6d300f58c33ece706e7edd18fe9750a4c3827bbf8f64 WatchSource:0}: Error finding container e2966c375a0a178afb1e6d300f58c33ece706e7edd18fe9750a4c3827bbf8f64: Status 404 returned error can't find the container with id e2966c375a0a178afb1e6d300f58c33ece706e7edd18fe9750a4c3827bbf8f64 Jun 11 13:30:28.662423 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.662385 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"f6a0728de2a4683bbbd4b4272ef09b4ea3e4b671593a9ed3cba2ecb78181dd06"} Jun 11 13:30:28.662601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.662472 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"038cb3c60bfc8305cecef3636fae14bd42c435a30afc94de301aeb84028e621a"} Jun 11 13:30:28.662601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.662517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"5b448750b31d34798f0914e4d2159dd1b9c025592af178d368bdafa6be0e51bd"} Jun 11 13:30:28.662601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.662555 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"49c6cd440990a8ad852d8745bf9ceea76b819d998c0818c6056a40a6812bf90b"} Jun 11 13:30:28.662601 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.662594 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"989076993dd6e565decd597cf0bdcbf200e42c753091024fd92d564dd76e8fba"} Jun 11 13:30:28.664767 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.664720 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"b5ab7cf814679b63facfb34fdb090603e841bacd58f9e3a222508eb591486ae9"} Jun 11 13:30:28.664894 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.664815 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"d890bde08f0bd00e3d0455dcc2e62218b3f0b3db1cb15a06c43d0a79f8e790e4"} Jun 11 13:30:28.664894 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.664858 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"4b0459d1116c197601f3d48e25a862dd4a8f2955fa225ecad555e9e589f4c44e"} Jun 11 13:30:28.666305 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.666276 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8" exitCode=0 Jun 11 13:30:28.666410 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.666341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8"} Jun 11 13:30:28.666410 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:28.666390 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"e2966c375a0a178afb1e6d300f58c33ece706e7edd18fe9750a4c3827bbf8f64"} Jun 11 13:30:29.675061 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.675025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerStarted","Data":"86d0dec7f89a547cd7d76a6bc97b785e4957d38eff9cb01b26bfa28b8e644089"} Jun 11 13:30:29.677832 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.677802 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"e98b269409d7bb274a6dd01d056bded0eaecfb94a86caa0b164c300fa985aa3a"} Jun 11 13:30:29.677969 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.677856 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"eba61c9ea11077bbf89ac3e5b8260bca9d28da2f656e4c3e0e2920dc87f89874"} Jun 11 13:30:29.677969 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.677882 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" event={"ID":"c7a5d293-f3d5-4247-92ec-6cc2da8e07c1","Type":"ContainerStarted","Data":"6d2721b0b638db11573485876a2ea94c1c54e29ac5498b603ec876144ba91f07"} Jun 11 13:30:29.677969 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.677911 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:29.700714 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.700671 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.801282142 podStartE2EDuration="7.700655818s" totalImagesPullingTime="3.883857058s" totalInitContainerRuntime="15.516618ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:29.698568704 +0000 UTC m=+274.496903775" watchObservedRunningTime="2026-06-11 13:30:29.700655818 +0000 UTC m=+274.498990887" Jun 11 13:30:29.718719 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:29.718669 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" podStartSLOduration=2.095219154 podStartE2EDuration="5.718652952s" totalImagesPullingTime="3.623433798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:29.717256235 +0000 UTC m=+274.515591304" watchObservedRunningTime="2026-06-11 13:30:29.718652952 +0000 UTC m=+274.516988036" Jun 11 13:30:32.634263 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.634233 2552 scope.go:117] "RemoveContainer" containerID="41e2fa2783b7940e1c8810efc040ee1ae2b69ee01cac257e8f435f2de24d1441" Jun 11 13:30:32.693981 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.693955 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389"} Jun 11 13:30:32.694079 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.694027 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703"} Jun 11 13:30:32.694079 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.694066 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec"} Jun 11 13:30:32.694184 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.694099 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76"} Jun 11 13:30:32.694184 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.694122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0"} Jun 11 13:30:32.694184 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.694149 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerStarted","Data":"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb"} Jun 11 13:30:32.695689 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.695670 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:32.719681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:32.719605 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.375359468 podStartE2EDuration="5.719580883s" totalImagesPullingTime="3.326981599s" totalInitContainerRuntime="17.239816ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:32.718298298 +0000 UTC m=+277.516633370" watchObservedRunningTime="2026-06-11 13:30:32.719580883 +0000 UTC m=+277.517915953" Jun 11 13:30:33.041879 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.041848 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:30:33.598815 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.598756 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:33.699031 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.698988 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:33.701585 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.701564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:33.701686 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.701656 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" event={"ID":"adccfdb2-c8f2-448a-be0e-68c6d7a047f6","Type":"ContainerStarted","Data":"3f219263493fc172fec2cc3f66f8ef52efa403c3b491e1bfbc1bf47b52a586ed"} Jun 11 13:30:33.702301 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.702283 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:30:33.706687 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.706668 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" Jun 11 13:30:33.717410 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.717360 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-zq4qx" podStartSLOduration=53.504363103 podStartE2EDuration="56.717348173s" totalImagesPullingTime="3.21298507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:33.71677741 +0000 UTC m=+278.515112481" watchObservedRunningTime="2026-06-11 13:30:33.717348173 +0000 UTC m=+278.515683244" Jun 11 13:30:33.799897 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.799852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:33.897880 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:33.897790 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.269506 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.269422 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.319516 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.319488 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.663699 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.663665 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.711242 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.711208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.871413 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.871383 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:34.920546 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:34.920474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:35.078398 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:35.078366 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:35.189855 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:35.189778 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:35.293778 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:35.290815 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:35.688119 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:35.688096 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ffdfcdbc7-8s299" Jun 11 13:30:36.690411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:36.690376 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:37.290384 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:30:37.290341 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vltl5" podUID="235b6f00-bae2-4e2c-8734-31ae2fb9516f" Jun 11 13:30:37.716592 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:37.716515 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:40.542826 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:40.542771 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:40.545061 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:40.545041 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/235b6f00-bae2-4e2c-8734-31ae2fb9516f-metrics-tls\") pod \"dns-default-vltl5\" (UID: \"235b6f00-bae2-4e2c-8734-31ae2fb9516f\") " pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:40.719040 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:40.719008 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7xbz\"" Jun 11 13:30:40.727056 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:40.727036 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:40.870936 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:40.870907 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vltl5"] Jun 11 13:30:40.873357 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:30:40.873330 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235b6f00_bae2_4e2c_8734_31ae2fb9516f.slice/crio-afdfb5a0cabbcdc35a87185b425df502a14e52eabcc9e75a358d88c996f17ae8 WatchSource:0}: Error finding container afdfb5a0cabbcdc35a87185b425df502a14e52eabcc9e75a358d88c996f17ae8: Status 404 returned error can't find the container with id afdfb5a0cabbcdc35a87185b425df502a14e52eabcc9e75a358d88c996f17ae8 Jun 11 13:30:41.105958 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:41.105877 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:41.207006 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:41.206974 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:41.734159 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:41.734119 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vltl5" event={"ID":"235b6f00-bae2-4e2c-8734-31ae2fb9516f","Type":"ContainerStarted","Data":"afdfb5a0cabbcdc35a87185b425df502a14e52eabcc9e75a358d88c996f17ae8"} Jun 11 13:30:42.739758 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:42.739630 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vltl5" event={"ID":"235b6f00-bae2-4e2c-8734-31ae2fb9516f","Type":"ContainerStarted","Data":"fea3d22f5ca506d55d22724ae34c834f39a8d48e1e64312f854d9b67aeb2c3db"} Jun 11 13:30:42.739758 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:42.739696 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vltl5" event={"ID":"235b6f00-bae2-4e2c-8734-31ae2fb9516f","Type":"ContainerStarted","Data":"93f934edac45c30031b1b0fd388dec792cf18b4a4a105738041f7fc7615c91a4"} Jun 11 13:30:42.740273 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:42.739842 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:42.755894 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:42.755847 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vltl5" podStartSLOduration=251.325233211 podStartE2EDuration="4m12.755831901s" totalImagesPullingTime="1.43059869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:42.754221654 +0000 UTC m=+287.552556738" watchObservedRunningTime="2026-06-11 13:30:42.755831901 +0000 UTC m=+287.554167018" Jun 11 13:30:46.759361 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:46.759315 2552 generic.go:356] "Generic (PLEG): container finished" podID="3234bb8c-b7c8-4df9-965d-08ee7bbda103" containerID="eddc5cb7a57052eb9cf3c501951d08bce140e15f05b229ba483c9cb05ffee948" exitCode=0 Jun 11 13:30:46.759818 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:46.759370 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" event={"ID":"3234bb8c-b7c8-4df9-965d-08ee7bbda103","Type":"ContainerDied","Data":"eddc5cb7a57052eb9cf3c501951d08bce140e15f05b229ba483c9cb05ffee948"} Jun 11 13:30:46.759818 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:46.759780 2552 scope.go:117] "RemoveContainer" containerID="eddc5cb7a57052eb9cf3c501951d08bce140e15f05b229ba483c9cb05ffee948" Jun 11 13:30:47.765699 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:47.765663 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zrkk" event={"ID":"3234bb8c-b7c8-4df9-965d-08ee7bbda103","Type":"ContainerStarted","Data":"f7954f082f796cd7ff7a9b289ad16360c58a60fdf703d545257fa04278b075fa"} Jun 11 13:30:48.093169 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:48.093134 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:48.151154 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:48.151118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:51.104272 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:51.104240 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:51.204409 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:51.204376 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:52.746800 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:52.746769 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vltl5" Jun 11 13:30:54.125505 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:54.125470 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:54.181883 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:54.181845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.307012 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.306978 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.357202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.357172 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.594450 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.594362 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:55.595838 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.595812 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:30:55.599145 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.599124 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:30:55.600086 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.600067 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:30:55.606830 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:55.606811 2552 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 13:30:58.298674 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:58.298629 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:58.398757 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:58.398714 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:59.313337 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:59.313287 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:59.365434 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:30:59.365404 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.184002 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:00.183967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.236787 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:00.236755 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:01.331490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:01.331442 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:01.431639 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:01.431606 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:01.534436 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:01.534397 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:01.632546 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:01.632442 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.849509 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:06.849472 2552 generic.go:356] "Generic (PLEG): container finished" podID="881f8599-5a39-4754-9b13-dc38915dccbf" containerID="7498f88a53af02b09ccc1157c86d14b3f21d307986655324d992dc184b08347d" exitCode=0 Jun 11 13:31:06.849946 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:06.849517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" event={"ID":"881f8599-5a39-4754-9b13-dc38915dccbf","Type":"ContainerDied","Data":"7498f88a53af02b09ccc1157c86d14b3f21d307986655324d992dc184b08347d"} Jun 11 13:31:06.849946 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:06.849890 2552 scope.go:117] "RemoveContainer" containerID="7498f88a53af02b09ccc1157c86d14b3f21d307986655324d992dc184b08347d" Jun 11 13:31:07.237027 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.236980 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.291518 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.291488 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.375655 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.375625 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.457693 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.457659 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.516714 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.516587 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.854998 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:07.854963 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bhrrh" event={"ID":"881f8599-5a39-4754-9b13-dc38915dccbf","Type":"ContainerStarted","Data":"9d5a52a93c941a995fed128c59bdf25885cf12430c2455e0dd8622306b6ade90"} Jun 11 13:31:09.196615 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:09.196575 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:09.251239 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:09.251200 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.579439 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:11.579392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.680523 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:11.680486 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:14.503103 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:14.503071 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:14.555129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:14.555092 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:16.296455 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:16.296426 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:16.395874 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:16.395842 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:17.152072 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:17.152040 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:17.663044 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:17.663015 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbjrd_603a79c1-ffea-470f-a6a6-e371e95c912b/node-ca/0.log" Jun 11 13:31:18.064315 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:18.064286 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b48dbbf75-xhbjc_26820afc-0c42-4e65-b99e-93f9e5c6ae47/router/0.log" Jun 11 13:31:18.265705 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:18.265675 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49krr_acc1b6fd-fdba-4a4d-b064-a4923203db5e/serve-healthcheck-canary/0.log" Jun 11 13:31:28.041762 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:28.041710 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:28.058211 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:28.058185 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:28.952528 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:28.952498 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:31.306002 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:31.305967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:31.366788 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:31.366727 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:33.319478 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:33.319434 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:33.420151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:33.420114 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.477047 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:35.477008 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.533626 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:35.533596 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:40.698404 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:40.698369 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:41.017063 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.016985 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:41.761021 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.760990 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:41.761437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761252 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="alertmanager" containerID="cri-o://989076993dd6e565decd597cf0bdcbf200e42c753091024fd92d564dd76e8fba" gracePeriod=120 Jun 11 13:31:41.761437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761326 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-metric" containerID="cri-o://f6a0728de2a4683bbbd4b4272ef09b4ea3e4b671593a9ed3cba2ecb78181dd06" gracePeriod=120 Jun 11 13:31:41.761437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761340 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-web" containerID="cri-o://5b448750b31d34798f0914e4d2159dd1b9c025592af178d368bdafa6be0e51bd" gracePeriod=120 Jun 11 13:31:41.761437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761359 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy" containerID="cri-o://038cb3c60bfc8305cecef3636fae14bd42c435a30afc94de301aeb84028e621a" gracePeriod=120 Jun 11 13:31:41.761437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761378 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="config-reloader" containerID="cri-o://49c6cd440990a8ad852d8745bf9ceea76b819d998c0818c6056a40a6812bf90b" gracePeriod=120 Jun 11 13:31:41.761681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.761458 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="prom-label-proxy" containerID="cri-o://86d0dec7f89a547cd7d76a6bc97b785e4957d38eff9cb01b26bfa28b8e644089" gracePeriod=120 Jun 11 13:31:41.998144 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998071 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="86d0dec7f89a547cd7d76a6bc97b785e4957d38eff9cb01b26bfa28b8e644089" exitCode=0 Jun 11 13:31:41.998144 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998096 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="038cb3c60bfc8305cecef3636fae14bd42c435a30afc94de301aeb84028e621a" exitCode=0 Jun 11 13:31:41.998144 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998102 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="49c6cd440990a8ad852d8745bf9ceea76b819d998c0818c6056a40a6812bf90b" exitCode=0 Jun 11 13:31:41.998144 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998111 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="989076993dd6e565decd597cf0bdcbf200e42c753091024fd92d564dd76e8fba" exitCode=0 Jun 11 13:31:41.998396 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998139 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"86d0dec7f89a547cd7d76a6bc97b785e4957d38eff9cb01b26bfa28b8e644089"} Jun 11 13:31:41.998396 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"038cb3c60bfc8305cecef3636fae14bd42c435a30afc94de301aeb84028e621a"} Jun 11 13:31:41.998396 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998229 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"49c6cd440990a8ad852d8745bf9ceea76b819d998c0818c6056a40a6812bf90b"} Jun 11 13:31:41.998396 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:41.998255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"989076993dd6e565decd597cf0bdcbf200e42c753091024fd92d564dd76e8fba"} Jun 11 13:31:43.011253 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011223 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="f6a0728de2a4683bbbd4b4272ef09b4ea3e4b671593a9ed3cba2ecb78181dd06" exitCode=0 Jun 11 13:31:43.011253 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011248 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerID="5b448750b31d34798f0914e4d2159dd1b9c025592af178d368bdafa6be0e51bd" exitCode=0 Jun 11 13:31:43.011619 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011286 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"f6a0728de2a4683bbbd4b4272ef09b4ea3e4b671593a9ed3cba2ecb78181dd06"} Jun 11 13:31:43.011619 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011376 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"5b448750b31d34798f0914e4d2159dd1b9c025592af178d368bdafa6be0e51bd"} Jun 11 13:31:43.011619 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011404 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ca9540-33a5-4fca-8fef-64636f4bc407","Type":"ContainerDied","Data":"45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d"} Jun 11 13:31:43.011619 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.011431 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ba709d0e4ad332197dee92e03f2d54201ffc10379a73a808cb21404230d99d" Jun 11 13:31:43.013641 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.013624 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:43.109947 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.109859 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.109947 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.109904 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.109947 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.109924 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.109951 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.109988 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq69k\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110006 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110029 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110062 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110085 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110110 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110137 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110164 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110216 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110187 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db\") pod \"b9ca9540-33a5-4fca-8fef-64636f4bc407\" (UID: \"b9ca9540-33a5-4fca-8fef-64636f4bc407\") " Jun 11 13:31:43.110706 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110492 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:43.110706 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110510 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:43.110843 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.110702 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:31:43.113105 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.112749 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.113411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.113369 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.113515 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.113457 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.113680 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.113645 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out" (OuterVolumeSpecName: "config-out") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:31:43.113898 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.113875 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume" (OuterVolumeSpecName: "config-volume") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.113985 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.113948 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:31:43.114709 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.114689 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k" (OuterVolumeSpecName: "kube-api-access-vq69k") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "kube-api-access-vq69k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:31:43.115010 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.114987 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.117446 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.117420 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.123955 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.123933 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config" (OuterVolumeSpecName: "web-config") pod "b9ca9540-33a5-4fca-8fef-64636f4bc407" (UID: "b9ca9540-33a5-4fca-8fef-64636f4bc407"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:43.210991 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.210954 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq69k\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-kube-api-access-vq69k\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.210991 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.210983 2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-metrics-client-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.210991 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.210994 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-out\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211024 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-web-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211033 2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-cluster-tls-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211041 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ca9540-33a5-4fca-8fef-64636f4bc407-tls-assets\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211049 2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211059 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211068 2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-main-db\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211077 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-main-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211085 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211096 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ca9540-33a5-4fca-8fef-64636f4bc407-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:43.211210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:43.211107 2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ca9540-33a5-4fca-8fef-64636f4bc407-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:44.015628 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.015544 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.035151 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.035116 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:44.038284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.038261 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:44.062030 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062000 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062437 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-web" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062459 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-web" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062471 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="alertmanager" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062479 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="alertmanager" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062494 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="config-reloader" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062502 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="config-reloader" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062512 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="prom-label-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062521 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="prom-label-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062548 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062557 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062569 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="init-config-reloader" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062577 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="init-config-reloader" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062585 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-metric" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062593 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-metric" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062665 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="config-reloader" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062675 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062686 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="prom-label-proxy" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062699 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-metric" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062707 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="alertmanager" Jun 11 13:31:44.064552 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.062714 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" containerName="kube-rbac-proxy-web" Jun 11 13:31:44.068053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.068029 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.070620 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.070599 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 13:31:44.070748 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.070599 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 13:31:44.071102 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071079 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 13:31:44.071202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071142 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 13:31:44.071202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071154 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q2smw\"" Jun 11 13:31:44.071202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071166 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 13:31:44.071202 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071085 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 13:31:44.071432 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071332 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 13:31:44.071432 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.071366 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 13:31:44.076157 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.075988 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 13:31:44.077666 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.077647 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:44.118880 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.118846 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-out\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.118889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.118912 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.118947 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-volume\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119003 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119035 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119022 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119039 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119065 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-web-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.119495 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.119303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jcq\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-kube-api-access-t2jcq\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220274 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-volume\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220274 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220276 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220303 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220373 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-web-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220507 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jcq\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-kube-api-access-t2jcq\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-out\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.220763 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.220707 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.221109 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.221082 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.221762 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.221715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.222706 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.222681 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7026be89-f9ff-49d8-b21e-1c7adc806c15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.223547 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.223167 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.223547 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.223466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.223547 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.223496 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.223792 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.223600 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.223792 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.223632 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-web-config\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.224145 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.224126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-volume\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.224335 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.224312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.224837 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.224817 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7026be89-f9ff-49d8-b21e-1c7adc806c15-config-out\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.225399 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.225378 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7026be89-f9ff-49d8-b21e-1c7adc806c15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.229909 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.229888 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jcq\" (UniqueName: \"kubernetes.io/projected/7026be89-f9ff-49d8-b21e-1c7adc806c15-kube-api-access-t2jcq\") pod \"alertmanager-main-0\" (UID: \"7026be89-f9ff-49d8-b21e-1c7adc806c15\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.379461 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.379424 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 13:31:44.523021 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:44.522972 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 13:31:44.525630 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:31:44.525607 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7026be89_f9ff_49d8_b21e_1c7adc806c15.slice/crio-9b325b0f672c2bd8bb3f525873cb3b6b0d314595b8d63dbf6b6930091f747f4d WatchSource:0}: Error finding container 9b325b0f672c2bd8bb3f525873cb3b6b0d314595b8d63dbf6b6930091f747f4d: Status 404 returned error can't find the container with id 9b325b0f672c2bd8bb3f525873cb3b6b0d314595b8d63dbf6b6930091f747f4d Jun 11 13:31:45.020867 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:45.020827 2552 generic.go:356] "Generic (PLEG): container finished" podID="7026be89-f9ff-49d8-b21e-1c7adc806c15" containerID="7b68ef0d788fbfc31a8aeea54774c9e3f7d0e0f786a925d0d4500af5e9ff5a65" exitCode=0 Jun 11 13:31:45.021236 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:45.020885 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerDied","Data":"7b68ef0d788fbfc31a8aeea54774c9e3f7d0e0f786a925d0d4500af5e9ff5a65"} Jun 11 13:31:45.021236 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:45.020952 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"9b325b0f672c2bd8bb3f525873cb3b6b0d314595b8d63dbf6b6930091f747f4d"} Jun 11 13:31:45.639611 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:45.639580 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ca9540-33a5-4fca-8fef-64636f4bc407" path="/var/lib/kubelet/pods/b9ca9540-33a5-4fca-8fef-64636f4bc407/volumes" Jun 11 13:31:46.029199 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029171 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"958429919c81f51c78fcec5fb3441378a23d9cabd66c5b5826e7e804df849f56"} Jun 11 13:31:46.029569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029234 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"c40f8b031d339aef46a77ecdc58d2ed15d9d9419098155b546559fb1b82fe4eb"} Jun 11 13:31:46.029569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029266 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"c422808434f9706a74b7a58cbc46d0078a45de9da242a5c8597bb4426f97300c"} Jun 11 13:31:46.029569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029290 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"92bbff51fc8172181d5f333987f7c8e5205ee4a44c1269844969baade753affa"} Jun 11 13:31:46.029569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029313 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"2a4cdc0daf2ae6fcbd3355dd52be9000f3dbf56961e9947bcd02882616505432"} Jun 11 13:31:46.029569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.029337 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7026be89-f9ff-49d8-b21e-1c7adc806c15","Type":"ContainerStarted","Data":"efe412e678b33045cd3c8691f92d06dedab528d46b685a6f3a540372751d6f2e"} Jun 11 13:31:46.042084 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042057 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:46.042352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042323 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy" containerID="cri-o://70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703" gracePeriod=600 Jun 11 13:31:46.042352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042338 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="config-reloader" containerID="cri-o://d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0" gracePeriod=600 Jun 11 13:31:46.042481 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042357 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389" gracePeriod=600 Jun 11 13:31:46.042481 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042375 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-web" containerID="cri-o://d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec" gracePeriod=600 Jun 11 13:31:46.042481 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042322 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="prometheus" containerID="cri-o://511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb" gracePeriod=600 Jun 11 13:31:46.042481 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.042328 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="thanos-sidecar" containerID="cri-o://6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76" gracePeriod=600 Jun 11 13:31:46.058299 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:46.058247 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.03981085 podStartE2EDuration="2.058225658s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.414808ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:46.057083142 +0000 UTC m=+350.855418212" watchObservedRunningTime="2026-06-11 13:31:46.058225658 +0000 UTC m=+350.856560729" Jun 11 13:31:47.037346 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037317 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389" exitCode=0 Jun 11 13:31:47.037346 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037342 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703" exitCode=0 Jun 11 13:31:47.037346 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037348 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76" exitCode=0 Jun 11 13:31:47.037346 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037354 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0" exitCode=0 Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037359 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb" exitCode=0 Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037392 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389"} Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037479 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703"} Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037522 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76"} Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0"} Jun 11 13:31:47.037908 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.037600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb"} Jun 11 13:31:47.293862 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.293808 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:47.347677 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347636 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.347862 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347746 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.347862 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347780 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.347862 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347810 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.347862 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347837 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347875 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347899 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmgr\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347938 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347965 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.347996 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348022 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348062 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348087 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348116 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348142 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348170 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348203 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348212 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348235 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348269 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.348411 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348303 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls\") pod \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\" (UID: \"fd9c832b-cc9c-48f0-8053-3536b185ddcb\") " Jun 11 13:31:47.350162 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.348582 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.350162 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.349395 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.350162 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.349520 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.350378 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.350349 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.351038 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.350821 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.351614 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.351265 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.351614 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.351331 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.351614 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.351348 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr" (OuterVolumeSpecName: "kube-api-access-dqmgr") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "kube-api-access-dqmgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:31:47.351614 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.351403 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config" (OuterVolumeSpecName: "config") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.351903 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.351606 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.352170 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.352134 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:31:47.352374 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.352342 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:31:47.353056 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353032 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.353361 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353327 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.353621 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353592 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.353752 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353599 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out" (OuterVolumeSpecName: "config-out") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:31:47.353752 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353703 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:31:47.353939 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.353916 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.354442 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.354415 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.364611 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.364586 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config" (OuterVolumeSpecName: "web-config") pod "fd9c832b-cc9c-48f0-8053-3536b185ddcb" (UID: "fd9c832b-cc9c-48f0-8053-3536b185ddcb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:31:47.449060 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449026 2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-metrics-client-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449060 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449060 2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449075 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-db\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449087 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmgr\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-kube-api-access-dqmgr\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449100 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449113 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449125 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd9c832b-cc9c-48f0-8053-3536b185ddcb-tls-assets\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449135 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config-out\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449146 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449158 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449171 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449183 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449194 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-web-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449206 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449217 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449229 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c832b-cc9c-48f0-8053-3536b185ddcb-configmap-metrics-client-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449240 2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-grpc-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449252 2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:47.449293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:47.449264 2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd9c832b-cc9c-48f0-8053-3536b185ddcb-secret-kube-rbac-proxy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:31:48.044691 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.044657 2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerID="d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec" exitCode=0 Jun 11 13:31:48.045048 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.044747 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.045048 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.044750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec"} Jun 11 13:31:48.045048 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.044825 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd9c832b-cc9c-48f0-8053-3536b185ddcb","Type":"ContainerDied","Data":"e2966c375a0a178afb1e6d300f58c33ece706e7edd18fe9750a4c3827bbf8f64"} Jun 11 13:31:48.045048 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.044867 2552 scope.go:117] "RemoveContainer" containerID="051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389" Jun 11 13:31:48.056354 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.056338 2552 scope.go:117] "RemoveContainer" containerID="70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703" Jun 11 13:31:48.063812 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.063707 2552 scope.go:117] "RemoveContainer" containerID="d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec" Jun 11 13:31:48.069772 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.069705 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:48.072136 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.072117 2552 scope.go:117] "RemoveContainer" containerID="6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76" Jun 11 13:31:48.072612 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.072590 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:48.079012 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.078995 2552 scope.go:117] "RemoveContainer" containerID="d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0" Jun 11 13:31:48.087085 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.087064 2552 scope.go:117] "RemoveContainer" containerID="511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb" Jun 11 13:31:48.094789 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.094770 2552 scope.go:117] "RemoveContainer" containerID="95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8" Jun 11 13:31:48.099265 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099242 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:48.099574 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099562 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="thanos-sidecar" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099575 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="thanos-sidecar" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099588 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-thanos" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099593 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-thanos" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099602 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-web" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099607 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-web" Jun 11 13:31:48.099618 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099615 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099620 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099629 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="prometheus" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099635 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="prometheus" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099642 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="config-reloader" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099647 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="config-reloader" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099653 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="init-config-reloader" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099658 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="init-config-reloader" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099704 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="thanos-sidecar" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099712 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="config-reloader" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099718 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="prometheus" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099724 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099756 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-thanos" Jun 11 13:31:48.099836 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.099764 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" containerName="kube-rbac-proxy-web" Jun 11 13:31:48.101911 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.101895 2552 scope.go:117] "RemoveContainer" containerID="051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389" Jun 11 13:31:48.102171 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.102152 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389\": container with ID starting with 051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389 not found: ID does not exist" containerID="051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389" Jun 11 13:31:48.102217 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102179 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389"} err="failed to get container status \"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389\": rpc error: code = NotFound desc = could not find container \"051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389\": container with ID starting with 051cc71d2a4915e3219c8e791c201476b7050a25c2bc56c6706de55ecc976389 not found: ID does not exist" Jun 11 13:31:48.102217 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102214 2552 scope.go:117] "RemoveContainer" containerID="70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703" Jun 11 13:31:48.102421 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.102407 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703\": container with ID starting with 70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703 not found: ID does not exist" containerID="70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703" Jun 11 13:31:48.102465 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102425 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703"} err="failed to get container status \"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703\": rpc error: code = NotFound desc = could not find container \"70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703\": container with ID starting with 70f2cd1d4f9f5842772451d6da7132081f8ec6bad68cd419809b4168cc315703 not found: ID does not exist" Jun 11 13:31:48.102465 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102438 2552 scope.go:117] "RemoveContainer" containerID="d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec" Jun 11 13:31:48.102672 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.102656 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec\": container with ID starting with d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec not found: ID does not exist" containerID="d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec" Jun 11 13:31:48.102713 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102677 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec"} err="failed to get container status \"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec\": rpc error: code = NotFound desc = could not find container \"d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec\": container with ID starting with d48d80468a66f2cf51134b3902c5ba0af2ee27b5d60d8e9b94af46eeb69164ec not found: ID does not exist" Jun 11 13:31:48.102713 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102689 2552 scope.go:117] "RemoveContainer" containerID="6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76" Jun 11 13:31:48.102924 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.102907 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76\": container with ID starting with 6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76 not found: ID does not exist" containerID="6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76" Jun 11 13:31:48.102982 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102925 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76"} err="failed to get container status \"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76\": rpc error: code = NotFound desc = could not find container \"6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76\": container with ID starting with 6a6bb873a40381ac923eabe68b5276a9f932de09ae44b4f8db0a067bf5f9cc76 not found: ID does not exist" Jun 11 13:31:48.102982 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.102948 2552 scope.go:117] "RemoveContainer" containerID="d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0" Jun 11 13:31:48.103261 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.103240 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0\": container with ID starting with d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0 not found: ID does not exist" containerID="d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0" Jun 11 13:31:48.103317 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.103268 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0"} err="failed to get container status \"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0\": rpc error: code = NotFound desc = could not find container \"d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0\": container with ID starting with d026cdcfa2365c89862efa0c2ccac271bb634455e7472793f17536f17ff731a0 not found: ID does not exist" Jun 11 13:31:48.103317 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.103283 2552 scope.go:117] "RemoveContainer" containerID="511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb" Jun 11 13:31:48.103530 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.103513 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb\": container with ID starting with 511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb not found: ID does not exist" containerID="511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb" Jun 11 13:31:48.103571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.103533 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb"} err="failed to get container status \"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb\": rpc error: code = NotFound desc = could not find container \"511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb\": container with ID starting with 511ff96c6c4687e0815dd35b6221c08bb6df225b67ef65067431e5af5509bddb not found: ID does not exist" Jun 11 13:31:48.103571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.103547 2552 scope.go:117] "RemoveContainer" containerID="95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8" Jun 11 13:31:48.103793 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:31:48.103770 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8\": container with ID starting with 95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8 not found: ID does not exist" containerID="95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8" Jun 11 13:31:48.103841 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.103800 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8"} err="failed to get container status \"95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8\": rpc error: code = NotFound desc = could not find container \"95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8\": container with ID starting with 95f2fa4558f71bf981834d6514dccae88638c68dc7f2f86b41d53ac6794991f8 not found: ID does not exist" Jun 11 13:31:48.104438 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.104426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.106543 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.106525 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 13:31:48.106900 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.106886 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 13:31:48.106962 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.106912 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 13:31:48.107015 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.106999 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 13:31:48.107193 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a743hee29ofni\"" Jun 11 13:31:48.107309 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107247 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-86s59\"" Jun 11 13:31:48.107668 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107650 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 13:31:48.107791 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107650 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 13:31:48.107791 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107651 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 13:31:48.107990 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.107975 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 13:31:48.108087 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.108071 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 13:31:48.108194 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.108142 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 13:31:48.108194 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.108179 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 13:31:48.108194 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.108145 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 13:31:48.108486 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.108466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 13:31:48.109632 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.109613 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 13:31:48.112607 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.112587 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 13:31:48.117672 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.117649 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:48.155281 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155281 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155283 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155392 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155423 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bgw\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-kube-api-access-w2bgw\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155490 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155486 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155603 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155617 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.155717 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155681 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.156032 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155722 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.156032 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155780 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.156032 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.155805 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256175 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256140 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256175 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256198 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256217 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256242 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256271 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256325 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256346 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256376 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256400 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256436 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256499 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256545 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bgw\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-kube-api-access-w2bgw\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.256917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.256693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.257351 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.257071 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.257351 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.257261 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.259493 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.259692 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.259805 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259746 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.259805 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.259918 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259805 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.260014 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.259994 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.260094 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.260009 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.260853 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.260477 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f855b21d-3e06-475e-ac09-ffe0f14169c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.260853 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.260615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.261008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.260900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.261008 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.260940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.261195 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.261169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.261610 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.261588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.262133 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.262105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.262332 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.262316 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.263121 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.263104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f855b21d-3e06-475e-ac09-ffe0f14169c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.263169 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.263157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f855b21d-3e06-475e-ac09-ffe0f14169c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.266860 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.266840 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bgw\" (UniqueName: \"kubernetes.io/projected/f855b21d-3e06-475e-ac09-ffe0f14169c1-kube-api-access-w2bgw\") pod \"prometheus-k8s-0\" (UID: \"f855b21d-3e06-475e-ac09-ffe0f14169c1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.415353 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.415271 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:48.569837 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:48.569811 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:48.571824 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:31:48.571789 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf855b21d_3e06_475e_ac09_ffe0f14169c1.slice/crio-4ea10db0d025cc9b957e781b92e3306b47cd8c78761fd45565ee227ff04ff733 WatchSource:0}: Error finding container 4ea10db0d025cc9b957e781b92e3306b47cd8c78761fd45565ee227ff04ff733: Status 404 returned error can't find the container with id 4ea10db0d025cc9b957e781b92e3306b47cd8c78761fd45565ee227ff04ff733 Jun 11 13:31:49.051512 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:49.051480 2552 generic.go:356] "Generic (PLEG): container finished" podID="f855b21d-3e06-475e-ac09-ffe0f14169c1" containerID="029d344cfcfe1c2878e1543723eecff888786e5790849b7611da182f33375efe" exitCode=0 Jun 11 13:31:49.051948 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:49.051578 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerDied","Data":"029d344cfcfe1c2878e1543723eecff888786e5790849b7611da182f33375efe"} Jun 11 13:31:49.051948 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:49.051649 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"4ea10db0d025cc9b957e781b92e3306b47cd8c78761fd45565ee227ff04ff733"} Jun 11 13:31:49.640598 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:49.640516 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd9c832b-cc9c-48f0-8053-3536b185ddcb" path="/var/lib/kubelet/pods/fd9c832b-cc9c-48f0-8053-3536b185ddcb/volumes" Jun 11 13:31:50.060437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060397 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"551019a077175737e3ce34c9cb14b0434e62392523a3c138e2efda804616f15b"} Jun 11 13:31:50.060816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060483 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"cf74437cc3117e5c1d9a46a704db79850b2941b50d49e63de13ace0c232d5601"} Jun 11 13:31:50.060816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060523 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"1a0d8fb3308f20cfdb507d86a32a436f1f118bd00ba32706accc5f253f97f02b"} Jun 11 13:31:50.060816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060563 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"99a498cfa47d2b622c7dbdcb233c77ff32dc9b289b384a1fa3e1ce5c2301c45e"} Jun 11 13:31:50.060816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060599 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"69c7ec13a16aa05cbd1a3f88fcfb22e5555c8c912b5349271a7f03b154e59cf0"} Jun 11 13:31:50.060816 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.060633 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f855b21d-3e06-475e-ac09-ffe0f14169c1","Type":"ContainerStarted","Data":"2a9e3f4dfc2ade36705cf19af99f02e7c97edb5161e483ab1ec406d6a15909f6"} Jun 11 13:31:50.086781 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:50.086688 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.067000286 podStartE2EDuration="2.08666577s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.665484ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:50.085419304 +0000 UTC m=+354.883754377" watchObservedRunningTime="2026-06-11 13:31:50.08666577 +0000 UTC m=+354.885000852" Jun 11 13:31:51.216517 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:51.216485 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.272918 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:51.272887 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.356823 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:51.356795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.430405 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:51.430376 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.958428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:51.958393 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:52.012593 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:52.012541 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:53.415721 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:53.415680 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:53.956180 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:31:53.956136 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:01.304090 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:01.304043 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:01.354376 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:01.354346 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:02.553448 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:02.553413 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:02.611061 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:02.611030 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:02.671242 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:02.671213 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:47.204689 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:47.204631 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:48.416068 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:48.416031 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:48.431586 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:48.431561 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:49.335011 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:49.334983 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:55.920480 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:55.920441 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:56.021473 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:32:56.021429 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:07.858882 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:07.858845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:07.932527 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:07.932493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:11.773440 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:11.773408 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:11.823572 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:11.823521 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:11.916971 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:11.916930 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:12.018886 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:12.018800 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:12.516827 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:12.516787 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:12.574786 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:12.574756 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:16.300721 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:16.300684 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:16.400921 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:16.400883 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:16.612020 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:16.611932 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:22.835124 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:22.835087 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:22.886471 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:22.886434 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:22.941933 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:33:22.941900 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:05.676692 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:05.676656 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:10.215774 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:10.215719 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:10.314045 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:10.314010 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:36.523118 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:36.523088 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:38.268529 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:38.268492 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:40.930707 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:40.930671 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:40.982830 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:40.982793 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:41.582787 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:41.582754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:41.674582 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:41.674547 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:44.866957 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:44.866922 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:45.456500 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:45.456467 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:48.562219 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:48.562182 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:48.614571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:48.614541 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:53.269022 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:34:53.268984 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:06.149902 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:06.149865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:07.346928 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:07.346896 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:15.925365 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:15.925335 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:16.026553 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:16.026523 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:16.528817 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:16.528778 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:16.627230 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:16.627195 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:18.451988 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.451955 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc"] Jun 11 13:35:18.458868 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.458840 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.461029 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.460999 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:35:18.461165 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.461055 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 11 13:35:18.461818 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.461795 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-68s5c\"" Jun 11 13:35:18.465466 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.465446 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc"] Jun 11 13:35:18.547083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.547052 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsbjc\" (UniqueName: \"kubernetes.io/projected/db5476dc-eacf-4496-9eca-89c1376b861e-kube-api-access-wsbjc\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.547244 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.547093 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db5476dc-eacf-4496-9eca-89c1376b861e-tmp\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.647916 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.647880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsbjc\" (UniqueName: \"kubernetes.io/projected/db5476dc-eacf-4496-9eca-89c1376b861e-kube-api-access-wsbjc\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.648075 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.647961 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db5476dc-eacf-4496-9eca-89c1376b861e-tmp\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.648231 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.648214 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db5476dc-eacf-4496-9eca-89c1376b861e-tmp\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.655118 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.655092 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsbjc\" (UniqueName: \"kubernetes.io/projected/db5476dc-eacf-4496-9eca-89c1376b861e-kube-api-access-wsbjc\") pod \"jobset-operator-5bc45f897-hrjjc\" (UID: \"db5476dc-eacf-4496-9eca-89c1376b861e\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.776820 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.776793 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" Jun 11 13:35:18.903712 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.903628 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc"] Jun 11 13:35:18.906755 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:35:18.906702 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb5476dc_eacf_4496_9eca_89c1376b861e.slice/crio-37ccfe2d185cdacfb9b7d57a89b1563802283b08a1646b1987ef3e25d8d87499 WatchSource:0}: Error finding container 37ccfe2d185cdacfb9b7d57a89b1563802283b08a1646b1987ef3e25d8d87499: Status 404 returned error can't find the container with id 37ccfe2d185cdacfb9b7d57a89b1563802283b08a1646b1987ef3e25d8d87499 Jun 11 13:35:18.908642 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.908623 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:35:18.937784 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:18.937750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" event={"ID":"db5476dc-eacf-4496-9eca-89c1376b861e","Type":"ContainerStarted","Data":"37ccfe2d185cdacfb9b7d57a89b1563802283b08a1646b1987ef3e25d8d87499"} Jun 11 13:35:23.962028 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:23.961990 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" event={"ID":"db5476dc-eacf-4496-9eca-89c1376b861e","Type":"ContainerStarted","Data":"03827f8c506cd0b2014d03587bd27106de40ac8e9f07cf17d6aaa7898fc54783"} Jun 11 13:35:23.978461 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:23.978411 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-hrjjc" podStartSLOduration=1.9812962939999998 podStartE2EDuration="5.978393247s" totalImagesPullingTime="3.997096953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:35:23.976441898 +0000 UTC m=+568.774776972" watchObservedRunningTime="2026-06-11 13:35:23.978393247 +0000 UTC m=+568.776728316" Jun 11 13:35:27.511428 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:27.511391 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:27.912580 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:27.912542 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:28.015338 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:28.015250 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:29.728660 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:29.728601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:53.553221 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:53.553182 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:53.653962 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:53.653928 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:55.630827 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:55.630796 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:35:55.631294 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:55.631262 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:35:55.634681 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:55.634652 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:35:55.635378 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:55.635357 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:35:56.351506 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:56.351472 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:56.570110 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:35:56.570066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:00.427189 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:00.427131 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:07.448161 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:07.448118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:09.595379 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:09.595343 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:37.018210 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:37.018176 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:47.567990 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:47.567956 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:48.949365 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:48.949310 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:55.633474 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.633439 2552 scope.go:117] "RemoveContainer" containerID="f6a0728de2a4683bbbd4b4272ef09b4ea3e4b671593a9ed3cba2ecb78181dd06" Jun 11 13:36:55.641919 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.641897 2552 scope.go:117] "RemoveContainer" containerID="038cb3c60bfc8305cecef3636fae14bd42c435a30afc94de301aeb84028e621a" Jun 11 13:36:55.650880 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.650843 2552 scope.go:117] "RemoveContainer" containerID="86d0dec7f89a547cd7d76a6bc97b785e4957d38eff9cb01b26bfa28b8e644089" Jun 11 13:36:55.657932 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.657912 2552 scope.go:117] "RemoveContainer" containerID="989076993dd6e565decd597cf0bdcbf200e42c753091024fd92d564dd76e8fba" Jun 11 13:36:55.665023 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.665004 2552 scope.go:117] "RemoveContainer" containerID="87a14b9ca23dc4be65130a704363503c73ff455d3b0c262181f249ed8aff135c" Jun 11 13:36:55.672056 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.672038 2552 scope.go:117] "RemoveContainer" containerID="5b448750b31d34798f0914e4d2159dd1b9c025592af178d368bdafa6be0e51bd" Jun 11 13:36:55.678674 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:36:55.678653 2552 scope.go:117] "RemoveContainer" containerID="49c6cd440990a8ad852d8745bf9ceea76b819d998c0818c6056a40a6812bf90b" Jun 11 13:37:08.192367 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:37:08.192331 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:40.247542 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:37:40.247503 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:40.320403 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:37:40.320368 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:45.479246 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:37:45.479169 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:45.535779 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:37:45.535725 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:08.803959 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.803927 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ht25/must-gather-zjf2v"] Jun 11 13:38:08.804355 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.804142 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:08.806711 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.806695 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.809000 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.808977 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ht25\"/\"openshift-service-ca.crt\"" Jun 11 13:38:08.809811 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.809795 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ht25\"/\"kube-root-ca.crt\"" Jun 11 13:38:08.809874 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.809796 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ht25\"/\"default-dockercfg-vhpjg\"" Jun 11 13:38:08.819457 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.819433 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ht25/must-gather-zjf2v"] Jun 11 13:38:08.828186 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.828160 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.828384 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.828205 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwx9x\" (UniqueName: \"kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.858557 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.858527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:08.929189 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.929158 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.929345 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.929197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwx9x\" (UniqueName: \"kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.929528 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.929508 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:08.936156 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:08.936133 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwx9x\" (UniqueName: \"kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x\") pod \"must-gather-zjf2v\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:09.116270 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:09.116190 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:38:09.244487 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:09.244292 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ht25/must-gather-zjf2v"] Jun 11 13:38:09.247302 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:38:09.247274 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78f655b3_bcb7_42a6_8004_58a402db1c79.slice/crio-1b0b2ebdfe1835a8f6f8f42170013ab366258f3575ea5fa97fd3863e3119bf05 WatchSource:0}: Error finding container 1b0b2ebdfe1835a8f6f8f42170013ab366258f3575ea5fa97fd3863e3119bf05: Status 404 returned error can't find the container with id 1b0b2ebdfe1835a8f6f8f42170013ab366258f3575ea5fa97fd3863e3119bf05 Jun 11 13:38:09.679137 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:09.679101 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ht25/must-gather-zjf2v" event={"ID":"78f655b3-bcb7-42a6-8004-58a402db1c79","Type":"ContainerStarted","Data":"1b0b2ebdfe1835a8f6f8f42170013ab366258f3575ea5fa97fd3863e3119bf05"} Jun 11 13:38:15.712242 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:15.712205 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ht25/must-gather-zjf2v" event={"ID":"78f655b3-bcb7-42a6-8004-58a402db1c79","Type":"ContainerStarted","Data":"d928182718760bcfa50182a55ceba5f679d45a5eff31bcd897722e9d9f6520e4"} Jun 11 13:38:15.712654 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:15.712249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ht25/must-gather-zjf2v" event={"ID":"78f655b3-bcb7-42a6-8004-58a402db1c79","Type":"ContainerStarted","Data":"3b627b749cec6e00a0ddbf6d193932ecef5c14ab7b915801a40ebad662eac84d"} Jun 11 13:38:15.727473 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:38:15.727426 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ht25/must-gather-zjf2v" podStartSLOduration=1.799725013 podStartE2EDuration="7.727408835s" totalImagesPullingTime="5.927683822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:38:15.726217304 +0000 UTC m=+740.524552375" watchObservedRunningTime="2026-06-11 13:38:15.727408835 +0000 UTC m=+740.525743904" Jun 11 13:39:00.931045 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:00.931007 2552 generic.go:356] "Generic (PLEG): container finished" podID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerID="3b627b749cec6e00a0ddbf6d193932ecef5c14ab7b915801a40ebad662eac84d" exitCode=0 Jun 11 13:39:00.931571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:00.931079 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ht25/must-gather-zjf2v" event={"ID":"78f655b3-bcb7-42a6-8004-58a402db1c79","Type":"ContainerDied","Data":"3b627b749cec6e00a0ddbf6d193932ecef5c14ab7b915801a40ebad662eac84d"} Jun 11 13:39:00.931571 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:00.931424 2552 scope.go:117] "RemoveContainer" containerID="3b627b749cec6e00a0ddbf6d193932ecef5c14ab7b915801a40ebad662eac84d" Jun 11 13:39:01.409743 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:01.409715 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ht25_must-gather-zjf2v_78f655b3-bcb7-42a6-8004-58a402db1c79/gather/0.log" Jun 11 13:39:01.809483 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:01.809448 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:01.961550 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:01.961517 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:02.018037 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:02.018002 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:04.545529 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:04.545501 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rsrkm_181f3dc2-17a4-4478-bb79-9effb8c16bac/global-pull-secret-syncer/0.log" Jun 11 13:39:04.608961 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:04.608931 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" Jun 11 13:39:04.699227 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:04.699191 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-110.ec2.internal_67f0da86fafeabede4d4debcf58e01a6/haproxy/0.log" Jun 11 13:39:06.791016 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:06.790974 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6ht25/must-gather-zjf2v"] Jun 11 13:39:06.791630 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:06.791240 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-6ht25/must-gather-zjf2v" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="copy" containerID="cri-o://d928182718760bcfa50182a55ceba5f679d45a5eff31bcd897722e9d9f6520e4" gracePeriod=2 Jun 11 13:39:06.793098 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:39:06.793061 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zjf2v\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ht25\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:39:06.793312 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:06.793295 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6ht25/must-gather-zjf2v"] Jun 11 13:39:06.962590 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:06.962566 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ht25_must-gather-zjf2v_78f655b3-bcb7-42a6-8004-58a402db1c79/copy/0.log" Jun 11 13:39:06.963055 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:06.963024 2552 generic.go:356] "Generic (PLEG): container finished" podID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerID="d928182718760bcfa50182a55ceba5f679d45a5eff31bcd897722e9d9f6520e4" exitCode=143 Jun 11 13:39:07.027284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.027261 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ht25_must-gather-zjf2v_78f655b3-bcb7-42a6-8004-58a402db1c79/copy/0.log" Jun 11 13:39:07.029129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.029110 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:39:07.030778 ip-10-0-141-110 kubenswrapper[2552]: E0611 13:39:07.030752 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zjf2v\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ht25\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:39:07.054284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.054226 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output\") pod \"78f655b3-bcb7-42a6-8004-58a402db1c79\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " Jun 11 13:39:07.054284 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.054273 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwx9x\" (UniqueName: \"kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x\") pod \"78f655b3-bcb7-42a6-8004-58a402db1c79\" (UID: \"78f655b3-bcb7-42a6-8004-58a402db1c79\") " Jun 11 13:39:07.056390 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.056365 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "78f655b3-bcb7-42a6-8004-58a402db1c79" (UID: "78f655b3-bcb7-42a6-8004-58a402db1c79"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:39:07.056475 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.056391 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x" (OuterVolumeSpecName: "kube-api-access-nwx9x") pod "78f655b3-bcb7-42a6-8004-58a402db1c79" (UID: "78f655b3-bcb7-42a6-8004-58a402db1c79"). InnerVolumeSpecName "kube-api-access-nwx9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:39:07.155771 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.155715 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwx9x\" (UniqueName: \"kubernetes.io/projected/78f655b3-bcb7-42a6-8004-58a402db1c79-kube-api-access-nwx9x\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:39:07.155771 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.155766 2552 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/78f655b3-bcb7-42a6-8004-58a402db1c79-must-gather-output\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\"" Jun 11 13:39:07.480565 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.480479 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:07.580856 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.580818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hsvkx_ef73d619-8584-479c-8450-74f1289e09c3/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:07.639053 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.639021 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" path="/var/lib/kubelet/pods/78f655b3-bcb7-42a6-8004-58a402db1c79/volumes" Jun 11 13:39:07.968359 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.968330 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ht25_must-gather-zjf2v_78f655b3-bcb7-42a6-8004-58a402db1c79/copy/0.log" Jun 11 13:39:07.968802 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.968708 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ht25/must-gather-zjf2v" Jun 11 13:39:07.968875 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.968712 2552 scope.go:117] "RemoveContainer" containerID="d928182718760bcfa50182a55ceba5f679d45a5eff31bcd897722e9d9f6520e4" Jun 11 13:39:07.976687 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:07.976659 2552 scope.go:117] "RemoveContainer" containerID="3b627b749cec6e00a0ddbf6d193932ecef5c14ab7b915801a40ebad662eac84d" Jun 11 13:39:08.444282 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.444258 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/alertmanager/0.log" Jun 11 13:39:08.467136 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.467111 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/config-reloader/0.log" Jun 11 13:39:08.487803 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.487777 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/kube-rbac-proxy-web/0.log" Jun 11 13:39:08.508830 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.508800 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/kube-rbac-proxy/0.log" Jun 11 13:39:08.531697 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.531652 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/kube-rbac-proxy-metric/0.log" Jun 11 13:39:08.559289 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.559265 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/prom-label-proxy/0.log" Jun 11 13:39:08.586352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.586309 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7026be89-f9ff-49d8-b21e-1c7adc806c15/init-config-reloader/0.log" Jun 11 13:39:08.650375 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.650332 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-47v6n_c66b7040-da6d-4e35-9753-a2ab4f6dcc6c/kube-state-metrics/0.log" Jun 11 13:39:08.680638 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.680611 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-47v6n_c66b7040-da6d-4e35-9753-a2ab4f6dcc6c/kube-rbac-proxy-main/0.log" Jun 11 13:39:08.700455 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.700387 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-47v6n_c66b7040-da6d-4e35-9753-a2ab4f6dcc6c/kube-rbac-proxy-self/0.log" Jun 11 13:39:08.826433 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.826406 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6djl_4af201b7-b5ec-4a48-a144-14704ddeff20/node-exporter/0.log" Jun 11 13:39:08.845594 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.845569 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6djl_4af201b7-b5ec-4a48-a144-14704ddeff20/kube-rbac-proxy/0.log" Jun 11 13:39:08.864964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:08.864938 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6djl_4af201b7-b5ec-4a48-a144-14704ddeff20/init-textfile/0.log" Jun 11 13:39:09.036194 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.036169 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-t9fh7_a8b69c7f-5fd1-4fd8-9996-0baacada18eb/kube-rbac-proxy-main/0.log" Jun 11 13:39:09.055239 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.055200 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-t9fh7_a8b69c7f-5fd1-4fd8-9996-0baacada18eb/kube-rbac-proxy-self/0.log" Jun 11 13:39:09.073534 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.073493 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-t9fh7_a8b69c7f-5fd1-4fd8-9996-0baacada18eb/openshift-state-metrics/0.log" Jun 11 13:39:09.106553 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.106529 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/prometheus/0.log" Jun 11 13:39:09.125449 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.125429 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/config-reloader/0.log" Jun 11 13:39:09.146672 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.146647 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/thanos-sidecar/0.log" Jun 11 13:39:09.169757 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.169715 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/kube-rbac-proxy-web/0.log" Jun 11 13:39:09.192275 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.192251 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/kube-rbac-proxy/0.log" Jun 11 13:39:09.212346 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.212325 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/kube-rbac-proxy-thanos/0.log" Jun 11 13:39:09.236014 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.235942 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f855b21d-3e06-475e-ac09-ffe0f14169c1/init-config-reloader/0.log" Jun 11 13:39:09.303810 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.303780 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-f5tpf_2d53d19d-7396-4500-982f-5786d6383c69/prometheus-operator-admission-webhook/0.log" Jun 11 13:39:09.405885 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.405859 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/thanos-query/0.log" Jun 11 13:39:09.424661 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.424639 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/kube-rbac-proxy-web/0.log" Jun 11 13:39:09.448859 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.448833 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/kube-rbac-proxy/0.log" Jun 11 13:39:09.469243 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.469217 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/prom-label-proxy/0.log" Jun 11 13:39:09.488314 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.488248 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/kube-rbac-proxy-rules/0.log" Jun 11 13:39:09.507523 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:09.507498 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffdfcdbc7-8s299_c7a5d293-f3d5-4247-92ec-6cc2da8e07c1/kube-rbac-proxy-metrics/0.log" Jun 11 13:39:11.227190 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:11.227160 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/2.log" Jun 11 13:39:11.231141 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:11.231119 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-zq4qx_adccfdb2-c8f2-448a-be0e-68c6d7a047f6/console-operator/3.log" Jun 11 13:39:12.089825 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.089721 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-khtk7_5bfabef7-3e45-4f8b-a324-1b1e6ef818a2/volume-data-source-validator/0.log" Jun 11 13:39:12.112749 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.112699 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv"] Jun 11 13:39:12.113072 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113059 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="copy" Jun 11 13:39:12.113116 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113073 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="copy" Jun 11 13:39:12.113116 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113097 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="gather" Jun 11 13:39:12.113116 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113102 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="gather" Jun 11 13:39:12.113205 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113167 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="gather" Jun 11 13:39:12.113205 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.113179 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f655b3-bcb7-42a6-8004-58a402db1c79" containerName="copy" Jun 11 13:39:12.116531 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.116516 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.118644 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.118629 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htsb6\"/\"kube-root-ca.crt\"" Jun 11 13:39:12.118708 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.118669 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-htsb6\"/\"default-dockercfg-862p8\"" Jun 11 13:39:12.119363 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.119348 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htsb6\"/\"openshift-service-ca.crt\"" Jun 11 13:39:12.124624 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.124596 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv"] Jun 11 13:39:12.196006 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.195968 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-sys\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.196006 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.196010 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-lib-modules\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.196212 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.196027 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6cfr\" (UniqueName: \"kubernetes.io/projected/a573309d-c84f-4a92-af64-f42ef20b4d64-kube-api-access-n6cfr\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.196212 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.196150 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-proc\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.196212 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.196192 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-podres\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.296776 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-podres\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296812 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-sys\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-lib-modules\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6cfr\" (UniqueName: \"kubernetes.io/projected/a573309d-c84f-4a92-af64-f42ef20b4d64-kube-api-access-n6cfr\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296885 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-sys\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296907 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-podres\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-proc\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.296991 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-proc\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.297129 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.297034 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a573309d-c84f-4a92-af64-f42ef20b4d64-lib-modules\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.303868 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.303835 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6cfr\" (UniqueName: \"kubernetes.io/projected/a573309d-c84f-4a92-af64-f42ef20b4d64-kube-api-access-n6cfr\") pod \"perf-node-gather-daemonset-9m6mv\" (UID: \"a573309d-c84f-4a92-af64-f42ef20b4d64\") " pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.427257 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.427167 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:12.559062 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.559028 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv"] Jun 11 13:39:12.562693 ip-10-0-141-110 kubenswrapper[2552]: W0611 13:39:12.562660 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda573309d_c84f_4a92_af64_f42ef20b4d64.slice/crio-0c7daadf62b5a5bf4630275a43cbafe3f6f3c6493861078bd4f92e0840318194 WatchSource:0}: Error finding container 0c7daadf62b5a5bf4630275a43cbafe3f6f3c6493861078bd4f92e0840318194: Status 404 returned error can't find the container with id 0c7daadf62b5a5bf4630275a43cbafe3f6f3c6493861078bd4f92e0840318194 Jun 11 13:39:12.992573 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.992535 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" event={"ID":"a573309d-c84f-4a92-af64-f42ef20b4d64","Type":"ContainerStarted","Data":"c2a59452d8acaaaf6ce8cd0ab7cf6feeed29392fb75c5e4ff0a4f51def3828ed"} Jun 11 13:39:12.992777 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.992595 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" event={"ID":"a573309d-c84f-4a92-af64-f42ef20b4d64","Type":"ContainerStarted","Data":"0c7daadf62b5a5bf4630275a43cbafe3f6f3c6493861078bd4f92e0840318194"} Jun 11 13:39:12.992777 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:12.992628 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:13.006163 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:13.006099 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" podStartSLOduration=1.006060312 podStartE2EDuration="1.006060312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:39:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:39:13.005696424 +0000 UTC m=+797.804031492" watchObservedRunningTime="2026-06-11 13:39:13.006060312 +0000 UTC m=+797.804395388" Jun 11 13:39:13.011743 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:13.011695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vltl5_235b6f00-bae2-4e2c-8734-31ae2fb9516f/dns/0.log" Jun 11 13:39:13.029433 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:13.029414 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vltl5_235b6f00-bae2-4e2c-8734-31ae2fb9516f/kube-rbac-proxy/0.log" Jun 11 13:39:13.068841 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:13.068813 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k8ptl_4a2c218c-6182-41b8-9594-b025d0106ea7/dns-node-resolver/0.log" Jun 11 13:39:13.496604 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:13.496578 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbjrd_603a79c1-ffea-470f-a6a6-e371e95c912b/node-ca/0.log" Jun 11 13:39:14.175019 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:14.174977 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b48dbbf75-xhbjc_26820afc-0c42-4e65-b99e-93f9e5c6ae47/router/0.log" Jun 11 13:39:14.478116 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:14.478031 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49krr_acc1b6fd-fdba-4a4d-b064-a4923203db5e/serve-healthcheck-canary/0.log" Jun 11 13:39:14.919325 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:14.919297 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrxms_cec4844d-a181-4423-b7c0-e23aac05be80/kube-rbac-proxy/0.log" Jun 11 13:39:14.937873 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:14.937849 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrxms_cec4844d-a181-4423-b7c0-e23aac05be80/exporter/0.log" Jun 11 13:39:14.956230 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:14.956203 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vrxms_cec4844d-a181-4423-b7c0-e23aac05be80/extractor/0.log" Jun 11 13:39:16.563165 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:16.563136 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-hrjjc_db5476dc-eacf-4496-9eca-89c1376b861e/jobset-operator/0.log" Jun 11 13:39:19.006293 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:19.006264 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-htsb6/perf-node-gather-daemonset-9m6mv" Jun 11 13:39:19.627838 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:19.627793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vfh7z_a96ac9d8-341e-480a-a2df-16544eab8697/migrator/0.log" Jun 11 13:39:19.645437 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:19.645410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vfh7z_a96ac9d8-341e-480a-a2df-16544eab8697/graceful-termination/0.log" Jun 11 13:39:19.913964 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:19.913869 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bhrrh_881f8599-5a39-4754-9b13-dc38915dccbf/kube-storage-version-migrator-operator/1.log" Jun 11 13:39:19.914702 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:19.914677 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bhrrh_881f8599-5a39-4754-9b13-dc38915dccbf/kube-storage-version-migrator-operator/0.log" Jun 11 13:39:20.924168 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:20.924094 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/kube-multus-additional-cni-plugins/0.log" Jun 11 13:39:20.943886 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:20.943858 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/egress-router-binary-copy/0.log" Jun 11 13:39:20.962695 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:20.962668 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/cni-plugins/0.log" Jun 11 13:39:20.981800 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:20.981775 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/bond-cni-plugin/0.log" Jun 11 13:39:21.001517 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.001494 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/routeoverride-cni/0.log" Jun 11 13:39:21.020814 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.020791 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/whereabouts-cni-bincopy/0.log" Jun 11 13:39:21.040001 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.039978 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2wj7_5cca170b-7a55-45a9-a701-a64f70a691cf/whereabouts-cni/0.log" Jun 11 13:39:21.398352 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.398325 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v6dth_4b6d88ca-1fdd-4c64-ab0d-68298eac9d29/kube-multus/0.log" Jun 11 13:39:21.420917 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.420882 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5d9lx_6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb/network-metrics-daemon/0.log" Jun 11 13:39:21.439761 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:21.439713 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5d9lx_6b2e9f9b-fc44-4dbb-ba3b-e25546d9a4cb/kube-rbac-proxy/0.log" Jun 11 13:39:22.382083 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.382050 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-controller/0.log" Jun 11 13:39:22.401217 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.401188 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/1.log" Jun 11 13:39:22.401217 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.401205 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovn-acl-logging/0.log" Jun 11 13:39:22.419569 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.419536 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/kube-rbac-proxy-node/0.log" Jun 11 13:39:22.440461 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.440437 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 13:39:22.456496 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.456477 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/northd/0.log" Jun 11 13:39:22.477530 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.477502 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/nbdb/0.log" Jun 11 13:39:22.496921 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.496893 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/sbdb/0.log" Jun 11 13:39:22.532600 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:22.532569 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82kl4_cadb7eb2-3604-4782-a39f-b71d6487721d/ovnkube-controller/0.log" Jun 11 13:39:23.592712 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:23.592683 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-95sfl_3859d18e-8071-4203-be45-f09afac1ea0c/network-check-target-container/0.log" Jun 11 13:39:24.446005 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:24.445970 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-27hxz_81611daa-28c5-4559-9b25-303c82f4e611/iptables-alerter/0.log" Jun 11 13:39:25.082691 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:25.082662 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hlkbz_8073a57e-76f8-4cf5-b97f-361ee184ba8b/tuned/0.log" Jun 11 13:39:27.603270 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:27.603230 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-4zrkk_3234bb8c-b7c8-4df9-965d-08ee7bbda103/service-ca-operator/1.log" Jun 11 13:39:27.604147 ip-10-0-141-110 kubenswrapper[2552]: I0611 13:39:27.604127 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-4zrkk_3234bb8c-b7c8-4df9-965d-08ee7bbda103/service-ca-operator/0.log"