Jun 06 18:58:41.072950 ip-10-0-130-40 systemd[1]: Starting Kubernetes Kubelet... Jun 06 18:58:41.544861 ip-10-0-130-40 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 18:58:41.544861 ip-10-0-130-40 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 18:58:41.544861 ip-10-0-130-40 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 18:58:41.544861 ip-10-0-130-40 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 18:58:41.544861 ip-10-0-130-40 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 18:58:41.546992 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.546864 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 18:58:41.552838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552817 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.552838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552834 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.552838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552838 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.552838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552842 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.552838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552845 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552849 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552852 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552855 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552858 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552860 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552865 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552867 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552870 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552873 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552876 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552879 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552882 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552884 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552887 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552889 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552892 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552894 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552897 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552900 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.553024 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552902 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552905 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552907 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552910 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552912 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552915 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552924 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552927 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552929 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552932 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552934 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552937 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552940 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552943 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552946 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552949 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552951 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552954 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552957 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552961 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.553485 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552965 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552968 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552971 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552973 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552976 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552978 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552982 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552986 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552989 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552992 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552995 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.552998 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553001 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553004 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553006 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553009 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553011 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553014 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553016 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.554080 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553019 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553022 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553025 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553028 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553031 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553034 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553037 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553040 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553042 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553045 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553048 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553050 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553053 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553055 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553058 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553060 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553063 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553065 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553068 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553070 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.554531 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553076 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553079 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553082 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553085 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553087 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553091 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553093 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553096 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553098 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553101 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553104 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553106 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553109 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553111 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553114 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553117 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553800 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553807 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553811 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553813 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.555066 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553817 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553819 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553822 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553825 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553827 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553830 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553833 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553835 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553838 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553840 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553843 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553847 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553851 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553855 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553858 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553860 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553863 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553866 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553868 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.555540 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553871 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553873 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553876 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553878 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553881 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553883 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553886 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553889 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553891 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553894 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553897 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553901 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553904 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553907 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553909 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553912 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553914 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553916 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553921 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553924 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.556032 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553927 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553931 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553934 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553937 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553939 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553942 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553945 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553948 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553950 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553953 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553955 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553958 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553960 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553963 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553966 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553969 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553972 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553975 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553977 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553980 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.556522 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553983 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553986 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553988 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553991 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553993 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553996 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.553999 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554001 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554004 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554006 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554009 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554012 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554014 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554016 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554019 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554021 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554024 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554028 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554031 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.557025 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554034 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554038 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554041 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554044 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554047 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554049 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554051 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554054 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554056 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554059 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554061 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554064 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554066 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554070 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554072 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554075 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554078 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554444 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554449 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554452 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.557482 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554454 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554457 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554460 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554463 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554466 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554468 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554471 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554474 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554478 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554482 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554485 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554488 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554490 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554494 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554496 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554499 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554502 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554506 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554510 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.557988 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554513 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554516 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554519 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554521 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554524 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554527 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554530 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554533 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554536 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554540 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554543 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554546 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554549 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554552 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554569 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554579 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554582 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554585 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554587 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554590 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.558444 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554592 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554595 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554597 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554600 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554602 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554605 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554607 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554610 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554613 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554615 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554618 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554621 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554623 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554626 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554628 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554631 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554633 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554636 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554639 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554641 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.558943 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554644 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554649 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554651 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554654 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554657 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554660 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554664 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554667 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554669 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554672 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554675 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554677 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554680 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554682 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554685 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554687 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554690 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554692 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554695 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.559427 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554697 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554700 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554703 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554706 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554708 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554710 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554713 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554715 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554718 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554720 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554723 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554726 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554729 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554731 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554735 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554737 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554740 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.554742 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554817 2548 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554826 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554835 2548 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 18:58:41.559914 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554841 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554847 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554852 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554860 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554869 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554874 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554879 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554883 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554886 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554889 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554892 2548 flags.go:64] FLAG: --cgroup-root="" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554895 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554898 2548 flags.go:64] FLAG: --client-ca-file="" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554902 2548 flags.go:64] FLAG: --cloud-provider="external" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554905 2548 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554909 2548 flags.go:64] FLAG: --cluster-domain="" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554912 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554915 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554919 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554922 2548 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554926 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554929 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554932 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 18:58:41.560424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554936 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554939 2548 flags.go:64] FLAG: --contention-profiling="false" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554944 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554947 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554950 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554953 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554957 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554960 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554963 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554966 2548 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554969 2548 flags.go:64] FLAG: --enable-server="true" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554971 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554975 2548 flags.go:64] FLAG: --event-burst="100" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554978 2548 flags.go:64] FLAG: --event-qps="50" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554981 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554985 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554987 2548 flags.go:64] FLAG: --eviction-hard="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554991 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554994 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.554997 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555002 2548 flags.go:64] FLAG: --eviction-soft="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555005 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555008 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555011 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555014 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 18:58:41.560998 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555017 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555020 2548 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555023 2548 flags.go:64] FLAG: --feature-gates="" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555027 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555030 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555033 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555036 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555039 2548 flags.go:64] FLAG: --healthz-port="10248" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555042 2548 flags.go:64] FLAG: --help="false" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555047 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555050 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555053 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555056 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555059 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555063 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555065 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555068 2548 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555071 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555074 2548 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555077 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555080 2548 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555083 2548 flags.go:64] FLAG: --kube-reserved="" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555086 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555089 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 18:58:41.562112 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555092 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555095 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555098 2548 flags.go:64] FLAG: --lock-file="" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555102 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555105 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555108 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555113 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555117 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555120 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555123 2548 flags.go:64] FLAG: --logging-format="text" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555125 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555129 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555132 2548 flags.go:64] FLAG: --manifest-url="" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555134 2548 flags.go:64] FLAG: --manifest-url-header="" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555139 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555141 2548 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555145 2548 flags.go:64] FLAG: --max-pods="110" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555149 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555152 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555154 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555157 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555160 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555163 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555166 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555172 2548 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 18:58:41.563192 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555175 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555178 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555181 2548 flags.go:64] FLAG: --pod-cidr="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555184 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555189 2548 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555191 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555194 2548 flags.go:64] FLAG: --pods-per-core="0" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555197 2548 flags.go:64] FLAG: --port="10250" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555200 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555203 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015b04e41cad8d314" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555206 2548 flags.go:64] FLAG: --qos-reserved="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555210 2548 flags.go:64] FLAG: --read-only-port="10255" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555213 2548 flags.go:64] FLAG: --register-node="true" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555216 2548 flags.go:64] FLAG: --register-with-taints="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555219 2548 flags.go:64] FLAG: --registry-burst="10" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555223 2548 flags.go:64] FLAG: --registry-qps="5" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555226 2548 flags.go:64] FLAG: --reserved-cpus="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555229 2548 flags.go:64] FLAG: --reserved-memory="" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555232 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555235 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555238 2548 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555241 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555244 2548 flags.go:64] FLAG: --runonce="false" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555246 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555250 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 18:58:41.563945 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555253 2548 flags.go:64] FLAG: --seccomp-default="false" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555256 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555258 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555261 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555264 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555267 2548 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555270 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555273 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555276 2548 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555279 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555282 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555285 2548 flags.go:64] FLAG: --system-cgroups="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555288 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555293 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555296 2548 flags.go:64] FLAG: --tls-cert-file="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555298 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555302 2548 flags.go:64] FLAG: --tls-min-version="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555305 2548 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555309 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555312 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555315 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555318 2548 flags.go:64] FLAG: --v="2" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555322 2548 flags.go:64] FLAG: --version="false" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555326 2548 flags.go:64] FLAG: --vmodule="" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555329 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 18:58:41.564817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555332 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555456 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555460 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555463 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555465 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555468 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555471 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555473 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555476 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555479 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555481 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555484 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555486 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555489 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555492 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555494 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555496 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555499 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555502 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555504 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.565859 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555507 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555509 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555511 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555514 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555517 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555520 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555523 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555525 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555528 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555530 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555533 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555536 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555538 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555541 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555544 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555546 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555549 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555567 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555570 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.566371 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555573 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555575 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555578 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555581 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555583 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555586 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555588 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555591 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555595 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555599 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555602 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555605 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555608 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555611 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555614 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555618 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555621 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555624 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555628 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.567169 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555631 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555633 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555636 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555638 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555641 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555644 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555647 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555649 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555652 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555654 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555657 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555661 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555663 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555666 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555668 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555671 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555674 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555678 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555681 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.568052 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555684 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555687 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555689 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555693 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555695 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555698 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555701 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555704 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555706 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555709 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555712 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555715 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555719 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555722 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555725 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555728 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555730 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555733 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555735 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555738 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.568604 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555741 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555744 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.555746 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.555752 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.563367 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.563385 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.564276 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.564289 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564373 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564381 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564387 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564392 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564397 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564402 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.569143 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564406 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564411 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564416 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564421 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564425 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564429 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564434 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564439 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564443 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564447 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564452 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564456 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564460 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564464 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564468 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564473 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564476 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564480 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564485 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.569530 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564489 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564495 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564500 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564505 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564512 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564516 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564521 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564525 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564529 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564536 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564541 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564546 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564551 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564572 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564576 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564581 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564585 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564589 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564594 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.570011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564599 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564603 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564607 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564611 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564615 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564620 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564624 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564628 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564632 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564637 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564641 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564645 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564649 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564653 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564657 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564662 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564667 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564672 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564677 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564681 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.570527 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564686 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564690 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564696 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564703 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564709 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564713 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564718 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564722 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564726 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564730 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564734 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564738 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564743 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564748 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564752 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564756 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564761 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564765 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564770 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564774 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.571026 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564778 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564782 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564786 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564791 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564795 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564799 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564803 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564807 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564811 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564816 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564820 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564825 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564829 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564833 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.564837 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.571576 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.564846 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565026 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565034 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565038 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565043 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565050 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565057 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565063 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565069 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565074 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565078 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565082 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565086 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565091 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565095 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565100 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565104 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565108 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565112 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565117 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 18:58:41.571994 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565121 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565125 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565129 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565134 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565138 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565143 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565148 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565152 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565156 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565163 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565167 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565171 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565175 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565179 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565184 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565188 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565193 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565197 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565201 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565205 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 18:58:41.572489 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565209 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565213 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565217 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565221 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565225 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565230 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565234 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565238 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565242 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565246 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565251 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565255 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565259 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565263 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565268 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565272 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565276 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565282 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565288 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565293 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 18:58:41.573144 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565297 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565301 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565306 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565310 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565315 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565319 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565323 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565327 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565331 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565335 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565339 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565344 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565348 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565355 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565360 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565365 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565370 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565374 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565378 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 18:58:41.573950 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565382 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565387 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565392 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565396 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565400 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565404 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565408 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565413 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565417 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565421 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565425 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565429 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565434 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565438 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565442 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565447 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565452 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565456 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565460 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565464 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 18:58:41.574745 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:41.565468 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.565477 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.565639 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.568497 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.570181 2548 server.go:1019] "Starting client certificate rotation" Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.570290 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.570330 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 18:58:41.575510 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.573473 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 18:58:41.576235 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.576216 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 18:58:41.589953 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.589932 2548 log.go:25] "Validated CRI v1 runtime API" Jun 06 18:58:41.592757 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.592745 2548 log.go:25] "Validated CRI v1 image API" Jun 06 18:58:41.593608 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.593590 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 18:58:41.598345 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.598327 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 18:58:41.599365 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.599345 2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 807a1cd7-34f6-492b-9950-7149e34b4787:/dev/nvme0n1p4 ac9c4dc0-e5d9-4e17-aef6-8e306835cd9d:/dev/nvme0n1p3] Jun 06 18:58:41.599456 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.599366 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 18:58:41.604878 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.604765 2548 manager.go:216] Machine: {Timestamp:2026-06-06 18:58:41.603338783 +0000 UTC m=+0.392730561 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088651 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec206e97992178adfd6e6465e14c38b8 SystemUUID:ec206e97-9921-78ad-fd6e-6465e14c38b8 BootID:50f04d23-1c00-4205-8d71-4b3255c702f9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:8c:47:93:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:8c:47:93:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:71:4b:ca:78:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 18:58:41.604878 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.604870 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 18:58:41.605020 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.604965 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 18:58:41.607600 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.607578 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 18:58:41.607729 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.607601 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 18:58:41.608538 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.608527 2548 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 18:58:41.608590 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.608539 2548 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 18:58:41.608590 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.608551 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 18:58:41.608590 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.608581 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 18:58:41.609809 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.609799 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 18:58:41.613993 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.613981 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 06 18:58:41.614096 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614087 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 18:58:41.614131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614117 2548 kubelet.go:486] "Attempting to sync node with API server" Jun 06 18:58:41.614131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614126 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 18:58:41.614203 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614136 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 18:58:41.614203 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614144 2548 kubelet.go:398] "Adding apiserver pod source" Jun 06 18:58:41.614203 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614153 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 18:58:41.614462 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614450 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 18:58:41.614493 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.614474 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 18:58:41.617044 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.617025 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 18:58:41.618720 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.618707 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 18:58:41.618775 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.618736 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 18:58:41.620051 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620040 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620056 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620063 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620068 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620078 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620083 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620090 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 18:58:41.620097 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620095 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 18:58:41.620276 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620102 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 18:58:41.620276 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620108 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 18:58:41.620276 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620116 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 18:58:41.620276 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.620122 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 18:58:41.621031 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.621020 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 18:58:41.621031 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.621031 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 18:58:41.626048 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.626035 2548 server.go:1268] "Started kubelet" Jun 06 18:58:41.626163 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.626131 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 18:58:41.630273 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.626112 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 18:58:41.630360 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.630303 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 18:58:41.630589 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.630537 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 18:58:41.630674 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.630590 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 18:58:41.630885 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.630866 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 18:58:41.631117 ip-10-0-130-40 systemd[1]: Started Kubernetes Kubelet. Jun 06 18:58:41.632415 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.632400 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 18:58:41.635184 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.635170 2548 server.go:310] "Adding debug handlers to kubelet server" Jun 06 18:58:41.636080 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.634979 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-40.ec2.internal.18b692fdd85d9cc7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-40.ec2.internal,UID:ip-10-0-130-40.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-40.ec2.internal,},FirstTimestamp:2026-06-06 18:58:41.626004679 +0000 UTC m=+0.415396454,LastTimestamp:2026-06-06 18:58:41.626004679 +0000 UTC m=+0.415396454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-40.ec2.internal,}" Jun 06 18:58:41.638821 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.638805 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 18:58:41.640136 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.640119 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbj2l" Jun 06 18:58:41.640382 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.640371 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 18:58:41.640513 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.640456 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 18:58:41.640513 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.640464 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:41.641181 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641159 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 18:58:41.641260 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641166 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 18:58:41.641260 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641204 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 18:58:41.641260 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641212 2548 factory.go:55] Registering systemd factory Jun 06 18:58:41.641260 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641226 2548 factory.go:223] Registration of the systemd container factory successfully Jun 06 18:58:41.641436 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641372 2548 reconstruct.go:97] "Volume reconstruction finished" Jun 06 18:58:41.641436 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641381 2548 reconciler.go:29] "Reconciler: start to sync state" Jun 06 18:58:41.641436 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641427 2548 factory.go:153] Registering CRI-O factory Jun 06 18:58:41.641575 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641440 2548 factory.go:223] Registration of the crio container factory successfully Jun 06 18:58:41.641575 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641486 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 18:58:41.641575 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641509 2548 factory.go:103] Registering Raw factory Jun 06 18:58:41.641575 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.641524 2548 manager.go:1196] Started watching for new ooms in manager Jun 06 18:58:41.642199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.642099 2548 manager.go:349] Starting recovery of all containers Jun 06 18:58:41.647612 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.647591 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbj2l" Jun 06 18:58:41.652638 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.652626 2548 manager.go:354] Recovery completed Jun 06 18:58:41.652868 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.652846 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 18:58:41.652868 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.652861 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 18:58:41.656517 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.656505 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.658382 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658367 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.658450 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658401 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.658450 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658411 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.658959 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658942 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 18:58:41.658959 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658952 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.658959 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658957 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 18:58:41.659085 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.658972 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 06 18:58:41.659675 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.659657 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.659738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.659687 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.659738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.659699 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.661210 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.661198 2548 policy_none.go:49] "None policy: Start" Jun 06 18:58:41.661271 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.661217 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 18:58:41.661271 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.661229 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 18:58:41.662988 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.662975 2548 policy_none.go:47] "Start" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.706682 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707079 2548 manager.go:337] "Starting Device Plugin manager" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.707114 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707127 2548 server.go:87] "Starting device plugin registration server" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707378 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707392 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707588 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707654 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.707662 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.708043 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.708093 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.708116 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.708154 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.708248 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.708312 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:41.718907 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.709991 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 18:58:41.808450 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.808377 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.808450 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.808398 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal"] Jun 06 18:58:41.808645 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.808472 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.809291 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.809275 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.809361 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.809301 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.809361 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.809312 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.809361 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.809331 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.810036 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.810022 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.810093 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.810049 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.810093 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.810062 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.812509 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.812496 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.812635 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.812622 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.812676 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.812662 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.813135 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813120 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.813224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813142 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.813224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813121 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.813224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813184 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.813224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813196 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.813224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.813152 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.815298 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.815284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.815376 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.815308 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 18:58:41.816021 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.816004 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jun 06 18:58:41.816098 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.816029 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 18:58:41.816098 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.816039 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jun 06 18:58:41.818017 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.818001 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.818074 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.818022 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-40.ec2.internal\": node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:41.842084 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.842065 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-40.ec2.internal\" not found" node="ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.842763 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.842747 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.842812 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.842770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be03cedf9326b812a91e6421c88187cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"be03cedf9326b812a91e6421c88187cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.842812 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.842787 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.844814 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.844690 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:41.846309 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.846294 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-40.ec2.internal\" not found" node="ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943417 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943381 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be03cedf9326b812a91e6421c88187cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"be03cedf9326b812a91e6421c88187cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943417 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943422 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943593 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943438 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943593 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943476 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943593 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943485 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be03cedf9326b812a91e6421c88187cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"be03cedf9326b812a91e6421c88187cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.943593 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:41.943488 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/081032fb23c5b4f4d075a9279215d491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"081032fb23c5b4f4d075a9279215d491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:41.945492 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:41.945476 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.046081 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.046057 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.146881 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.146819 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.148963 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.148949 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:42.153667 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.153412 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:42.247149 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.247119 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.347643 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.347600 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.448259 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.448182 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.548709 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.548669 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.569843 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.569822 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 18:58:42.569965 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.569948 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 18:58:42.648968 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:42.648939 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jun 06 18:58:42.651301 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.651276 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 18:53:41 +0000 UTC" deadline="2027-10-30 19:07:57.243173057 +0000 UTC" Jun 06 18:58:42.651354 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.651301 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12264h9m14.591875218s" Jun 06 18:58:42.697287 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.697261 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 18:58:42.701336 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.701295 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 18:58:42.741668 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.741636 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jun 06 18:58:42.756263 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.756241 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 18:58:42.758205 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.758184 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jun 06 18:58:42.774417 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.774393 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 18:58:42.853681 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:42.853656 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe03cedf9326b812a91e6421c88187cd.slice/crio-4f8c23a828c0594292fe68085b6aa9eb80372195b2154f01c88f711568ff93c2 WatchSource:0}: Error finding container 4f8c23a828c0594292fe68085b6aa9eb80372195b2154f01c88f711568ff93c2: Status 404 returned error can't find the container with id 4f8c23a828c0594292fe68085b6aa9eb80372195b2154f01c88f711568ff93c2 Jun 06 18:58:42.854197 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:42.854167 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081032fb23c5b4f4d075a9279215d491.slice/crio-4d1c03d653b0e7b0fc38e19f4472eff0f1d2d7667ce4b0039d6b89c686618b8c WatchSource:0}: Error finding container 4d1c03d653b0e7b0fc38e19f4472eff0f1d2d7667ce4b0039d6b89c686618b8c: Status 404 returned error can't find the container with id 4d1c03d653b0e7b0fc38e19f4472eff0f1d2d7667ce4b0039d6b89c686618b8c Jun 06 18:58:42.860248 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:42.860233 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 18:58:43.076969 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.076945 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 18:58:43.615270 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.615237 2548 apiserver.go:52] "Watching apiserver" Jun 06 18:58:43.624107 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.624076 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 18:58:43.626798 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.626757 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wp28k","openshift-multus/multus-additional-cni-plugins-ppgtq","openshift-network-diagnostics/network-check-target-n2qqk","openshift-network-operator/iptables-alerter-sw667","openshift-ovn-kubernetes/ovnkube-node-245w2","kube-system/global-pull-secret-syncer-fdtk2","kube-system/konnectivity-agent-chccm","kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw","openshift-cluster-node-tuning-operator/tuned-lbt7k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal","openshift-multus/multus-fqbwn","openshift-multus/network-metrics-daemon-8dmrz","openshift-dns/node-resolver-8wlv8"] Jun 06 18:58:43.629370 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.629345 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.631247 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.631222 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.631363 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.631302 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:43.632091 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.632071 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.632191 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.632120 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkjkh\"" Jun 06 18:58:43.632191 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.632122 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.633159 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.633139 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.635058 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635035 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.635652 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635637 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.635652 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635649 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.635813 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635680 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 18:58:43.635813 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635690 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mtrwq\"" Jun 06 18:58:43.635813 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.635637 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 18:58:43.637200 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.637179 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 18:58:43.637300 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.637223 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.637300 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.637255 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.637400 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.637365 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.637941 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.637819 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fjzvf\"" Jun 06 18:58:43.639416 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.639398 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 18:58:43.639956 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.639937 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640532 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640595 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640594 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640725 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640735 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640879 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 18:58:43.641013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.640899 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w8csm\"" Jun 06 18:58:43.642387 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.642368 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.643091 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.642998 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 18:58:43.643091 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.643005 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 18:58:43.643673 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.643582 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6zj6w\"" Jun 06 18:58:43.644599 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.644580 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.644685 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.644638 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.644739 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.644696 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:43.645541 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.645513 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.645638 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.645587 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 18:58:43.645638 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.645593 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94cr7\"" Jun 06 18:58:43.647329 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.647313 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.649868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.649739 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 18:58:43.649868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.649757 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 18:58:43.650093 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.650052 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rzt2l\"" Jun 06 18:58:43.650238 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.650220 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.652181 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652159 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-tuned\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.652262 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652207 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.652262 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652232 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6mct\" (UniqueName: \"kubernetes.io/projected/b28012c7-6a5d-4786-8b0f-f8768204271b-kube-api-access-t6mct\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.652391 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652270 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:43.652700 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652257 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.652835 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652815 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qq46\" (UniqueName: \"kubernetes.io/projected/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-kube-api-access-8qq46\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.652886 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652862 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-os-release\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.652928 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652893 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-cni-binary-copy\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653064 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.652923 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-socket-dir-parent\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653130 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653086 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxt6\" (UniqueName: \"kubernetes.io/projected/1ecd4c71-7629-4ba8-a670-2c34196f3277-kube-api-access-8zxt6\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653130 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653112 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73e564a6-5fc7-4cd4-8ad9-99f910c55150-agent-certs\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.653229 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653140 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653229 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653169 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-log-socket\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653229 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653198 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-daemon-config\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653229 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653224 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-tmp\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-var-lib-kubelet\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653277 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-k8s-cni-cncf-io\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653297 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-hostroot\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653316 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653333 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-systemd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653356 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-system-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653385 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-node-log\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653423 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-netd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653456 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02d13a65-10eb-4c32-8632-1975a236cf38-ovn-node-metrics-cert\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.653946 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-conf\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.653946 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.653467 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:43.653946 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653514 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-systemd\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.653946 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653544 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a03bc987-8ca6-4420-a52c-ece2d922af65-host\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.653946 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.653589 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-kubelet\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.654686 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.654667 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.655052 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.655036 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7tbjm\"" Jun 06 18:58:43.655253 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.655233 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 18:58:43.656039 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.655895 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 18:58:43.656039 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.655925 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.656206 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656065 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-netns\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656270 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656252 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdqhd\" (UniqueName: \"kubernetes.io/projected/a03bc987-8ca6-4420-a52c-ece2d922af65-kube-api-access-hdqhd\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.656324 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656306 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-bin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.656374 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656335 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-conf-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.656428 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656408 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-ovn\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656443 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-env-overrides\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656522 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656474 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.656522 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656505 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-etc-kubernetes\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.656636 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656549 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-kubelet\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656636 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-config\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656737 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656654 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-modprobe-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.656737 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656686 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-cnibin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.656737 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656717 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656879 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656750 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62pp6\" (UniqueName: \"kubernetes.io/projected/02d13a65-10eb-4c32-8632-1975a236cf38-kube-api-access-62pp6\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.656879 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656777 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysconfig\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.656879 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656830 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-kubernetes\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.657016 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656880 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6d8\" (UniqueName: \"kubernetes.io/projected/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-kube-api-access-7w6d8\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.657016 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656922 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-multus-certs\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.657016 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.656960 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-systemd-units\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657016 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657004 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-etc-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657039 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-run\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657073 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-host\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657103 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657153 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-sys\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657181 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-lib-modules\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.657255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657211 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-multus\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657293 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-bin\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657322 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657362 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a03bc987-8ca6-4420-a52c-ece2d922af65-serviceca\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657392 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73e564a6-5fc7-4cd4-8ad9-99f910c55150-konnectivity-ca\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657423 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-var-lib-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-script-lib\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.657530 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657523 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-socket-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657551 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657576 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-registration-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657606 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-device-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657631 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-sys-fs\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657659 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-netns\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.657868 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.657687 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-slash\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.660241 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.659991 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 18:58:43.660241 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.660068 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 18:58:43.660438 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.660421 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-twbnc\"" Jun 06 18:58:43.689277 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.689247 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlzxq" Jun 06 18:58:43.696796 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.696773 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlzxq" Jun 06 18:58:43.715450 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.715381 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" event={"ID":"be03cedf9326b812a91e6421c88187cd","Type":"ContainerStarted","Data":"4f8c23a828c0594292fe68085b6aa9eb80372195b2154f01c88f711568ff93c2"} Jun 06 18:58:43.717747 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.717719 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"081032fb23c5b4f4d075a9279215d491","Type":"ContainerStarted","Data":"4d1c03d653b0e7b0fc38e19f4472eff0f1d2d7667ce4b0039d6b89c686618b8c"} Jun 06 18:58:43.742546 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.742518 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 18:58:43.758683 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758653 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-systemd\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758701 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a03bc987-8ca6-4420-a52c-ece2d922af65-host\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758733 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/666e7b91-e223-443f-97b7-ef94cba8be98-hosts-file\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758757 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-systemd\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758759 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjft\" (UniqueName: \"kubernetes.io/projected/666e7b91-e223-443f-97b7-ef94cba8be98-kube-api-access-wpjft\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758802 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-dbus\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.758829 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758821 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a03bc987-8ca6-4420-a52c-ece2d922af65-host\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758865 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cnibin\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758896 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-kubelet\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758922 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-netns\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758940 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-kubelet\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758946 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdqhd\" (UniqueName: \"kubernetes.io/projected/a03bc987-8ca6-4420-a52c-ece2d922af65-kube-api-access-hdqhd\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758972 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-netns\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.758975 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666e7b91-e223-443f-97b7-ef94cba8be98-tmp-dir\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759000 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-bin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759037 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-conf-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759066 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-ovn\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759089 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-env-overrides\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759131 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759115 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759145 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759157 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-conf-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759171 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91bd7580-2e15-4224-adca-94299ceb0fda-iptables-alerter-script\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759179 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-ovn\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759201 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-etc-kubernetes\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759226 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-kubelet\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-bin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759251 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-config\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759277 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-modprobe-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759288 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-kubelet\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.759296 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759302 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759326 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759328 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-etc-kubernetes\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.759375 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:44.259353689 +0000 UTC m=+3.048745475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:43.759752 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759466 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-modprobe-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759547 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-cnibin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759610 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62pp6\" (UniqueName: \"kubernetes.io/projected/02d13a65-10eb-4c32-8632-1975a236cf38-kube-api-access-62pp6\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759657 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysconfig\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759681 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-kubernetes\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759684 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-cnibin\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759705 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6d8\" (UniqueName: \"kubernetes.io/projected/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-kube-api-access-7w6d8\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759733 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-env-overrides\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-kubelet-config\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759819 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-run-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759862 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-config\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759905 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759952 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-multus-certs\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759986 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-systemd-units\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.759995 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-kubernetes\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-etc-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.760581 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760027 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-multus-certs\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760086 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysconfig\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760100 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-systemd-units\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760109 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-run\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760116 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-etc-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760139 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-host\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760155 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-run\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760164 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-sys\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760199 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-host\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760211 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-lib-modules\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760235 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-multus\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760245 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760259 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-bin\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760275 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-sys\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760286 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760294 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-var-lib-cni-multus\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760312 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a03bc987-8ca6-4420-a52c-ece2d922af65-serviceca\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.761343 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760325 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-bin\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760339 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chq89\" (UniqueName: \"kubernetes.io/projected/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-kube-api-access-chq89\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760343 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760350 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-lib-modules\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760368 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73e564a6-5fc7-4cd4-8ad9-99f910c55150-konnectivity-ca\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-var-lib-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760419 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-script-lib\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760444 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-socket-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760456 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-var-lib-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760469 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-registration-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760497 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-device-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760521 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-sys-fs\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760546 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760602 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-netns\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760626 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-slash\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-tuned\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760673 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762196 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760700 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6mct\" (UniqueName: \"kubernetes.io/projected/b28012c7-6a5d-4786-8b0f-f8768204271b-kube-api-access-t6mct\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760727 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t242s\" (UniqueName: \"kubernetes.io/projected/91bd7580-2e15-4224-adca-94299ceb0fda-kube-api-access-t242s\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760776 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qq46\" (UniqueName: \"kubernetes.io/projected/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-kube-api-access-8qq46\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760799 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-os-release\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760823 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-cni-binary-copy\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760839 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a03bc987-8ca6-4420-a52c-ece2d922af65-serviceca\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760847 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-socket-dir-parent\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760873 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxt6\" (UniqueName: \"kubernetes.io/projected/1ecd4c71-7629-4ba8-a670-2c34196f3277-kube-api-access-8zxt6\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760896 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73e564a6-5fc7-4cd4-8ad9-99f910c55150-agent-certs\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760923 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760949 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-log-socket\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760974 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-daemon-config\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760998 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91bd7580-2e15-4224-adca-94299ceb0fda-host-slash\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761007 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02d13a65-10eb-4c32-8632-1975a236cf38-ovnkube-script-lib\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761018 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-socket-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761079 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-registration-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761107 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 18:58:43.762996 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761126 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-socket-dir-parent\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761134 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-sys-fs\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761022 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.760922 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73e564a6-5fc7-4cd4-8ad9-99f910c55150-konnectivity-ca\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761186 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-os-release\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761193 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-openvswitch\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761218 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-tmp\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761243 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-var-lib-kubelet\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761273 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-k8s-cni-cncf-io\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761297 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-hostroot\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761320 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761345 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-systemd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761371 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-system-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761397 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-node-log\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761421 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-netd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761447 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02d13a65-10eb-4c32-8632-1975a236cf38-ovn-node-metrics-cert\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761446 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.763867 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761126 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-conf\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761514 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28012c7-6a5d-4786-8b0f-f8768204271b-device-dir\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761371 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-os-release\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761629 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-conf\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-multus-daemon-config\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761679 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-var-lib-kubelet\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761701 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-cni-netd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761737 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-k8s-cni-cncf-io\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761767 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-hostroot\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761824 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ecd4c71-7629-4ba8-a670-2c34196f3277-cni-binary-copy\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761854 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-sysctl-d\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761876 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-log-socket\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761884 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-run-systemd\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761886 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-node-log\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761920 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-system-cni-dir\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761917 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ecd4c71-7629-4ba8-a670-2c34196f3277-host-run-netns\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.764679 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.761933 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02d13a65-10eb-4c32-8632-1975a236cf38-host-slash\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.765384 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.765076 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-tmp\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.765384 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.765237 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73e564a6-5fc7-4cd4-8ad9-99f910c55150-agent-certs\") pod \"konnectivity-agent-chccm\" (UID: \"73e564a6-5fc7-4cd4-8ad9-99f910c55150\") " pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.765384 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.765230 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-etc-tuned\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.765851 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.765828 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02d13a65-10eb-4c32-8632-1975a236cf38-ovn-node-metrics-cert\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.772027 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.772005 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdqhd\" (UniqueName: \"kubernetes.io/projected/a03bc987-8ca6-4420-a52c-ece2d922af65-kube-api-access-hdqhd\") pod \"node-ca-wp28k\" (UID: \"a03bc987-8ca6-4420-a52c-ece2d922af65\") " pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.776164 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.776131 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6d8\" (UniqueName: \"kubernetes.io/projected/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-kube-api-access-7w6d8\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:43.778185 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.778160 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62pp6\" (UniqueName: \"kubernetes.io/projected/02d13a65-10eb-4c32-8632-1975a236cf38-kube-api-access-62pp6\") pod \"ovnkube-node-245w2\" (UID: \"02d13a65-10eb-4c32-8632-1975a236cf38\") " pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.778278 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.778212 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxt6\" (UniqueName: \"kubernetes.io/projected/1ecd4c71-7629-4ba8-a670-2c34196f3277-kube-api-access-8zxt6\") pod \"multus-fqbwn\" (UID: \"1ecd4c71-7629-4ba8-a670-2c34196f3277\") " pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.778832 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.778810 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6mct\" (UniqueName: \"kubernetes.io/projected/b28012c7-6a5d-4786-8b0f-f8768204271b-kube-api-access-t6mct\") pod \"aws-ebs-csi-driver-node-5kbzw\" (UID: \"b28012c7-6a5d-4786-8b0f-f8768204271b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.780033 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.780016 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qq46\" (UniqueName: \"kubernetes.io/projected/b43bd377-37ea-4eff-9b77-1fcfdec4eee6-kube-api-access-8qq46\") pod \"tuned-lbt7k\" (UID: \"b43bd377-37ea-4eff-9b77-1fcfdec4eee6\") " pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.862717 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.862678 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.862717 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.862720 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91bd7580-2e15-4224-adca-94299ceb0fda-iptables-alerter-script\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.862949 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.862747 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:43.862949 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.862835 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:43.863063 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.862987 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:44.362963439 +0000 UTC m=+3.152355214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:43.863063 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863063 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863056 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863204 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863090 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-kubelet-config\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.863204 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863115 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863204 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863148 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chq89\" (UniqueName: \"kubernetes.io/projected/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-kube-api-access-chq89\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863204 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863177 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863205 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t242s\" (UniqueName: \"kubernetes.io/projected/91bd7580-2e15-4224-adca-94299ceb0fda-kube-api-access-t242s\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863222 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-kubelet-config\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863238 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91bd7580-2e15-4224-adca-94299ceb0fda-host-slash\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863248 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863261 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863287 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-os-release\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863324 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/666e7b91-e223-443f-97b7-ef94cba8be98-hosts-file\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863348 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjft\" (UniqueName: \"kubernetes.io/projected/666e7b91-e223-443f-97b7-ef94cba8be98-kube-api-access-wpjft\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863361 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91bd7580-2e15-4224-adca-94299ceb0fda-iptables-alerter-script\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.863380 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863371 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-dbus\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cnibin\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863447 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cnibin\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863488 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91bd7580-2e15-4224-adca-94299ceb0fda-host-slash\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863518 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-os-release\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863589 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/666e7b91-e223-443f-97b7-ef94cba8be98-hosts-file\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863611 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e70f01f5-9263-4184-9615-d3f5c853eab2-dbus\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863785 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666e7b91-e223-443f-97b7-ef94cba8be98-tmp-dir\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.863874 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.863803 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.864310 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.864063 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666e7b91-e223-443f-97b7-ef94cba8be98-tmp-dir\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.864310 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.864210 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.864641 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.864617 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.873384 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.873325 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:43.873384 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.873349 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:43.873384 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.873359 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:43.873594 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:43.873424 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:58:44.373406386 +0000 UTC m=+3.162798149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:43.875869 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.875842 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t242s\" (UniqueName: \"kubernetes.io/projected/91bd7580-2e15-4224-adca-94299ceb0fda-kube-api-access-t242s\") pod \"iptables-alerter-sw667\" (UID: \"91bd7580-2e15-4224-adca-94299ceb0fda\") " pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:43.878649 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.878627 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjft\" (UniqueName: \"kubernetes.io/projected/666e7b91-e223-443f-97b7-ef94cba8be98-kube-api-access-wpjft\") pod \"node-resolver-8wlv8\" (UID: \"666e7b91-e223-443f-97b7-ef94cba8be98\") " pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:43.880613 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.880591 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chq89\" (UniqueName: \"kubernetes.io/projected/6f45eb81-42b9-4309-a496-6dc1cdf88b8e-kube-api-access-chq89\") pod \"multus-additional-cni-plugins-ppgtq\" (UID: \"6f45eb81-42b9-4309-a496-6dc1cdf88b8e\") " pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:43.941129 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.941100 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" Jun 06 18:58:43.949854 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.949829 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqbwn" Jun 06 18:58:43.961514 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.961486 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 18:58:43.961783 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.961763 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wp28k" Jun 06 18:58:43.967521 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.967498 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:58:43.975166 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.975140 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:58:43.983716 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.983693 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" Jun 06 18:58:43.997307 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:43.997287 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" Jun 06 18:58:44.004984 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.004961 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw667" Jun 06 18:58:44.011816 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.011781 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wlv8" Jun 06 18:58:44.120893 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.120859 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d13a65_10eb_4c32_8632_1975a236cf38.slice/crio-00f06058b9803120a63f44126069c982ee58ec0502293316c63d38b14cce5697 WatchSource:0}: Error finding container 00f06058b9803120a63f44126069c982ee58ec0502293316c63d38b14cce5697: Status 404 returned error can't find the container with id 00f06058b9803120a63f44126069c982ee58ec0502293316c63d38b14cce5697 Jun 06 18:58:44.121848 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.121823 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bd7580_2e15_4224_adca_94299ceb0fda.slice/crio-ea774b1eadfd9305c4dd30ad0fc40778ee028013dde8a1cae01b062fa84d539f WatchSource:0}: Error finding container ea774b1eadfd9305c4dd30ad0fc40778ee028013dde8a1cae01b062fa84d539f: Status 404 returned error can't find the container with id ea774b1eadfd9305c4dd30ad0fc40778ee028013dde8a1cae01b062fa84d539f Jun 06 18:58:44.127011 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.126910 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f45eb81_42b9_4309_a496_6dc1cdf88b8e.slice/crio-801c99b913abd6d6856dd295b7ce3c5a8c3ded0df5875ea8162d6ea59353c467 WatchSource:0}: Error finding container 801c99b913abd6d6856dd295b7ce3c5a8c3ded0df5875ea8162d6ea59353c467: Status 404 returned error can't find the container with id 801c99b913abd6d6856dd295b7ce3c5a8c3ded0df5875ea8162d6ea59353c467 Jun 06 18:58:44.127861 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.127346 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43bd377_37ea_4eff_9b77_1fcfdec4eee6.slice/crio-a3f78c31ebfe573182557160d560d7495b15d08de26d668d58993ab905171f46 WatchSource:0}: Error finding container a3f78c31ebfe573182557160d560d7495b15d08de26d668d58993ab905171f46: Status 404 returned error can't find the container with id a3f78c31ebfe573182557160d560d7495b15d08de26d668d58993ab905171f46 Jun 06 18:58:44.128378 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.128299 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03bc987_8ca6_4420_a52c_ece2d922af65.slice/crio-4ed818c6e7b193ffdb47afb6f41f99adec9bc7e37e6fbfdea44bc776335aa768 WatchSource:0}: Error finding container 4ed818c6e7b193ffdb47afb6f41f99adec9bc7e37e6fbfdea44bc776335aa768: Status 404 returned error can't find the container with id 4ed818c6e7b193ffdb47afb6f41f99adec9bc7e37e6fbfdea44bc776335aa768 Jun 06 18:58:44.129838 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.129816 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666e7b91_e223_443f_97b7_ef94cba8be98.slice/crio-e0deb311fe6eac87465f2905348a0feacb98dfe0a391534f8621646073e75993 WatchSource:0}: Error finding container e0deb311fe6eac87465f2905348a0feacb98dfe0a391534f8621646073e75993: Status 404 returned error can't find the container with id e0deb311fe6eac87465f2905348a0feacb98dfe0a391534f8621646073e75993 Jun 06 18:58:44.130153 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.130077 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e564a6_5fc7_4cd4_8ad9_99f910c55150.slice/crio-0823a77ae7946b25e8575982132a9a3a75efdf3c1ee69ed45f5f080ff915e4e5 WatchSource:0}: Error finding container 0823a77ae7946b25e8575982132a9a3a75efdf3c1ee69ed45f5f080ff915e4e5: Status 404 returned error can't find the container with id 0823a77ae7946b25e8575982132a9a3a75efdf3c1ee69ed45f5f080ff915e4e5 Jun 06 18:58:44.152841 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:58:44.152813 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecd4c71_7629_4ba8_a670_2c34196f3277.slice/crio-ed8dfda853490016d76e9cd1f7d1ac8887ed310ee44a45fcc53a5bd153ea4b9e WatchSource:0}: Error finding container ed8dfda853490016d76e9cd1f7d1ac8887ed310ee44a45fcc53a5bd153ea4b9e: Status 404 returned error can't find the container with id ed8dfda853490016d76e9cd1f7d1ac8887ed310ee44a45fcc53a5bd153ea4b9e Jun 06 18:58:44.266551 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.266383 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:44.266551 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.266545 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:44.266739 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.266639 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:45.266620751 +0000 UTC m=+4.056012516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:44.367809 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.367764 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:44.367964 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.367933 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:44.368037 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.368000 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:45.367984066 +0000 UTC m=+4.157375837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:44.468200 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.468172 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:44.468331 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.468292 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:44.468331 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.468305 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:44.468331 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.468313 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:44.468441 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:44.468361 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:58:45.468348979 +0000 UTC m=+4.257740752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:44.700449 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.700340 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 18:53:43 +0000 UTC" deadline="2028-01-12 22:21:20.604843081 +0000 UTC" Jun 06 18:58:44.700449 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.700391 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14043h22m35.904456851s" Jun 06 18:58:44.721798 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.721765 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw667" event={"ID":"91bd7580-2e15-4224-adca-94299ceb0fda","Type":"ContainerStarted","Data":"ea774b1eadfd9305c4dd30ad0fc40778ee028013dde8a1cae01b062fa84d539f"} Jun 06 18:58:44.723899 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.723867 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chccm" event={"ID":"73e564a6-5fc7-4cd4-8ad9-99f910c55150","Type":"ContainerStarted","Data":"0823a77ae7946b25e8575982132a9a3a75efdf3c1ee69ed45f5f080ff915e4e5"} Jun 06 18:58:44.725607 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.725530 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wp28k" event={"ID":"a03bc987-8ca6-4420-a52c-ece2d922af65","Type":"ContainerStarted","Data":"4ed818c6e7b193ffdb47afb6f41f99adec9bc7e37e6fbfdea44bc776335aa768"} Jun 06 18:58:44.727995 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.727930 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerStarted","Data":"801c99b913abd6d6856dd295b7ce3c5a8c3ded0df5875ea8162d6ea59353c467"} Jun 06 18:58:44.730894 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.730808 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"00f06058b9803120a63f44126069c982ee58ec0502293316c63d38b14cce5697"} Jun 06 18:58:44.734959 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.734929 2548 generic.go:356] "Generic (PLEG): container finished" podID="081032fb23c5b4f4d075a9279215d491" containerID="5c35c1302b9d6dc7d3685543a493abab3eb8888895fbdcbb761378c5022e62b1" exitCode=0 Jun 06 18:58:44.735071 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.735048 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"081032fb23c5b4f4d075a9279215d491","Type":"ContainerDied","Data":"5c35c1302b9d6dc7d3685543a493abab3eb8888895fbdcbb761378c5022e62b1"} Jun 06 18:58:44.737092 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.737061 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqbwn" event={"ID":"1ecd4c71-7629-4ba8-a670-2c34196f3277","Type":"ContainerStarted","Data":"ed8dfda853490016d76e9cd1f7d1ac8887ed310ee44a45fcc53a5bd153ea4b9e"} Jun 06 18:58:44.739084 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.739048 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" event={"ID":"b43bd377-37ea-4eff-9b77-1fcfdec4eee6","Type":"ContainerStarted","Data":"a3f78c31ebfe573182557160d560d7495b15d08de26d668d58993ab905171f46"} Jun 06 18:58:44.741024 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.740979 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wlv8" event={"ID":"666e7b91-e223-443f-97b7-ef94cba8be98","Type":"ContainerStarted","Data":"e0deb311fe6eac87465f2905348a0feacb98dfe0a391534f8621646073e75993"} Jun 06 18:58:44.743095 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:44.743071 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" event={"ID":"b28012c7-6a5d-4786-8b0f-f8768204271b","Type":"ContainerStarted","Data":"5d015ece9d383d924421ba5b086abecc6488952d6733fe3ccab1b691f27a06e6"} Jun 06 18:58:45.275674 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.275633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:45.275889 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.275872 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:45.275957 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.275944 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:47.275922321 +0000 UTC m=+6.065314095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:45.376765 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.376733 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:45.377310 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.376902 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:45.377310 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.376977 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:47.376957468 +0000 UTC m=+6.166349234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:45.478911 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.478882 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:45.479090 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.479041 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:45.479090 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.479064 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:45.479090 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.479075 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:45.479255 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.479135 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:58:47.47911518 +0000 UTC m=+6.268506945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:45.700935 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.700869 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 18:53:43 +0000 UTC" deadline="2028-02-02 19:08:34.56719735 +0000 UTC" Jun 06 18:58:45.700935 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.700933 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14544h9m48.866268757s" Jun 06 18:58:45.710071 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.709682 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:45.710071 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.709890 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:45.710333 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.710313 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:45.710611 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.710407 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:45.712940 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.712809 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:45.712940 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:45.712912 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:45.760527 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.760488 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" event={"ID":"be03cedf9326b812a91e6421c88187cd","Type":"ContainerStarted","Data":"bf55cfb461ed484caa5598b50fb194d3de64d0996f8129f30cac881e10188170"} Jun 06 18:58:45.771330 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.771298 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"081032fb23c5b4f4d075a9279215d491","Type":"ContainerStarted","Data":"f511537f576397322e50f8c953c3660a6c3bbb6b91df465872019f62e59c425b"} Jun 06 18:58:45.796953 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:45.796844 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" podStartSLOduration=3.7968231980000002 podStartE2EDuration="3.796823198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:58:45.778891736 +0000 UTC m=+4.568283523" watchObservedRunningTime="2026-06-06 18:58:45.796823198 +0000 UTC m=+4.586214984" Jun 06 18:58:47.295184 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.295142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:47.295662 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.295352 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:47.295662 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.295418 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:51.295399291 +0000 UTC m=+10.084791075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:47.396308 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.396269 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:47.396536 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.396480 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:47.396683 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.396545 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:51.396527128 +0000 UTC m=+10.185918893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:47.497379 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.497342 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:47.497541 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.497531 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:47.497631 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.497567 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:47.497631 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.497581 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:47.497750 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.497638 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:58:51.497620131 +0000 UTC m=+10.287011892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:47.709248 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.709179 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:47.709384 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.709315 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:47.709834 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.709587 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:47.709834 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.709701 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:47.709834 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:47.709736 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:47.709834 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:47.709807 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:49.709505 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:49.709235 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:49.709505 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:49.709362 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:49.710033 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:49.709639 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:49.710033 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:49.709745 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:49.710033 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:49.709849 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:49.710033 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:49.709945 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:51.327667 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.327629 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:51.328111 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.327814 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:51.328111 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.327891 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:59.327874201 +0000 UTC m=+18.117265969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:51.428735 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.428698 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:51.428904 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.428840 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:51.428977 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.428917 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:58:59.428896746 +0000 UTC m=+18.218288509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:51.530133 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.530093 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:51.530280 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.530258 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:51.530280 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.530279 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:51.530396 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.530288 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:51.530396 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.530347 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:58:59.530328178 +0000 UTC m=+18.319719959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:51.712366 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.712264 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:51.712366 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.712290 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:51.712605 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.712376 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:51.712605 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:51.712392 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:51.712605 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.712497 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:51.712753 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:51.712602 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:53.711835 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:53.711772 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:53.712298 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:53.711897 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:53.712298 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:53.711908 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:53.712298 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:53.711903 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:53.712298 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:53.712022 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:53.712298 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:53.712115 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:55.709151 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:55.709122 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:55.709616 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:55.709240 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:55.709616 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:55.709313 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:55.709616 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:55.709422 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:55.709616 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:55.709466 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:55.709616 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:55.709543 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:57.709469 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:57.709386 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:57.709967 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:57.709388 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:57.709967 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:57.709516 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:57.709967 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:57.709530 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:57.709967 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:57.709676 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:58:57.709967 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:57.709747 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:59.392070 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.392038 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:59.392614 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.392200 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:59.392614 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.392266 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:15.39224661 +0000 UTC m=+34.181638378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:58:59.493307 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.493268 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:59.493467 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.493424 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:59.493533 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.493487 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:15.493470443 +0000 UTC m=+34.282862209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:58:59.594033 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.593999 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:59.594190 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.594131 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:58:59.594190 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.594150 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:58:59.594190 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.594158 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:59.594312 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.594221 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:59:15.594201694 +0000 UTC m=+34.383593478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:58:59.712516 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.712427 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:58:59.712700 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.712427 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:58:59.712700 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.712535 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:58:59.712700 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.712636 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:58:59.712700 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:58:59.712427 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:58:59.712913 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:58:59.712735 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:01.712044 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:01.712006 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:01.712044 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:01.712047 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:01.712619 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:01.712047 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:01.712619 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:01.712127 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:01.712619 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:01.712214 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:01.712619 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:01.712304 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:03.709190 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.708921 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:03.709771 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.708977 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:03.709771 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:03.709305 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:03.709771 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.709028 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:03.709771 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:03.709398 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:03.709771 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:03.709443 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:03.807074 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.807046 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqbwn" event={"ID":"1ecd4c71-7629-4ba8-a670-2c34196f3277","Type":"ContainerStarted","Data":"1f5c0e98c37bdec0fec4ec58d6ebe2d4b2026f4eac6f3a5d1414cfd8fe100e6e"} Jun 06 18:59:03.808810 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.808778 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" event={"ID":"b43bd377-37ea-4eff-9b77-1fcfdec4eee6","Type":"ContainerStarted","Data":"f946c3a8f45488fb898d5f201458c8cb762267cd4508f7f7659e423caa6f3c76"} Jun 06 18:59:03.810195 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.810174 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wlv8" event={"ID":"666e7b91-e223-443f-97b7-ef94cba8be98","Type":"ContainerStarted","Data":"51367d6cde3e9bee3b610a00c8c9b0934bbe980309b002ebac37a7c5a3892b92"} Jun 06 18:59:03.814224 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.814196 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" event={"ID":"b28012c7-6a5d-4786-8b0f-f8768204271b","Type":"ContainerStarted","Data":"e4a9e5f2ce0a96b48f2263ff6be4fd9b39683bf6aab9fb5483582a20b712a3aa"} Jun 06 18:59:03.815718 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.815695 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-chccm" event={"ID":"73e564a6-5fc7-4cd4-8ad9-99f910c55150","Type":"ContainerStarted","Data":"426dc5a019b800c4849353e45d08a28b294e403ae194ba2b3ad68b0a513bd0b1"} Jun 06 18:59:03.817120 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.817096 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wp28k" event={"ID":"a03bc987-8ca6-4420-a52c-ece2d922af65","Type":"ContainerStarted","Data":"6351c2eb4bcdf883fcef1e926b428454a12b526de19850cb2f6e288982e1e3df"} Jun 06 18:59:03.818589 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.818550 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="97d9315782b39124432ffb85c03d7526e084c0f87eb0db23a2b0e5a8e3497178" exitCode=0 Jun 06 18:59:03.818686 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.818643 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"97d9315782b39124432ffb85c03d7526e084c0f87eb0db23a2b0e5a8e3497178"} Jun 06 18:59:03.821143 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821126 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 18:59:03.821427 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821411 2548 generic.go:356] "Generic (PLEG): container finished" podID="02d13a65-10eb-4c32-8632-1975a236cf38" containerID="e877b1d08ee3532daf0c2c4d31ebb7a45c51479fcbe59f6646a3d9c8f051aa7b" exitCode=1 Jun 06 18:59:03.821476 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821436 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"a9a1ac66970ceea4d7edac919312bf1d6c5c8d9df0621a7eba031a0b003abf93"} Jun 06 18:59:03.821515 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821492 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"ecf2f6dca4db78917ca65f22022285180a56e7bfa38cb16d14250ad0c89386c5"} Jun 06 18:59:03.821546 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821530 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerDied","Data":"e877b1d08ee3532daf0c2c4d31ebb7a45c51479fcbe59f6646a3d9c8f051aa7b"} Jun 06 18:59:03.821591 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.821578 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"1d0537e8cc5874974b144c6150e9b1d9cb9d00c7e1f37906eb6e7f48ed77b6a5"} Jun 06 18:59:03.824242 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.824207 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" podStartSLOduration=21.82419542 podStartE2EDuration="21.82419542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:58:45.797263335 +0000 UTC m=+4.586655121" watchObservedRunningTime="2026-06-06 18:59:03.82419542 +0000 UTC m=+22.613587203" Jun 06 18:59:03.824336 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.824284 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fqbwn" podStartSLOduration=3.989798246 podStartE2EDuration="22.824275538s" totalImagesPullingTime="18.834477292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:03.82378123 +0000 UTC m=+22.613173024" watchObservedRunningTime="2026-06-06 18:59:03.824275538 +0000 UTC m=+22.613667324" Jun 06 18:59:03.858088 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.858039 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8wlv8" podStartSLOduration=11.123514949 podStartE2EDuration="21.858022535s" totalImagesPullingTime="10.734507586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:03.857782104 +0000 UTC m=+22.647173889" watchObservedRunningTime="2026-06-06 18:59:03.858022535 +0000 UTC m=+22.647414322" Jun 06 18:59:03.876304 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.876269 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lbt7k" podStartSLOduration=4.057838678 podStartE2EDuration="22.876257788s" totalImagesPullingTime="18.81841911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:03.876119988 +0000 UTC m=+22.665511772" watchObservedRunningTime="2026-06-06 18:59:03.876257788 +0000 UTC m=+22.665649569" Jun 06 18:59:03.890485 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:03.890452 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-chccm" podStartSLOduration=8.500864539 podStartE2EDuration="22.890439935s" totalImagesPullingTime="14.389575396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:03.890044796 +0000 UTC m=+22.679436580" watchObservedRunningTime="2026-06-06 18:59:03.890439935 +0000 UTC m=+22.679831719" Jun 06 18:59:04.517495 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.517366 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 18:59:04.719434 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.719333 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T18:59:04.517386227Z","UUID":"d27fcbe2-b1c6-407e-acec-9f3a7c747a72","Handler":null,"Name":"","Endpoint":""} Jun 06 18:59:04.720881 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.720862 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 18:59:04.721005 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.720897 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 18:59:04.825316 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.825288 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" event={"ID":"b28012c7-6a5d-4786-8b0f-f8768204271b","Type":"ContainerStarted","Data":"bbc1728364f977b4b46adcbb14d5e2d2996427ee55e602cc666a4c541f21711d"} Jun 06 18:59:04.826939 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.826912 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw667" event={"ID":"91bd7580-2e15-4224-adca-94299ceb0fda","Type":"ContainerStarted","Data":"5a956049eb8fe9eb7946e44f09c33eefe9828dc1e50b8b1fc436285073eae475"} Jun 06 18:59:04.833047 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.833029 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 18:59:04.833524 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.833499 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"903bda785b6ce0d7b960b26a2cfd2933ce8741c316111ac41cce33b12f3630d5"} Jun 06 18:59:04.833654 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.833639 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"670db02642ccd8ebd810ef029da36ea2e9322850f03cadd1b1f6dcb60c4601df"} Jun 06 18:59:04.842255 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.842209 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wp28k" podStartSLOduration=5.044567487 podStartE2EDuration="23.8421929s" totalImagesPullingTime="18.797625413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:03.913777235 +0000 UTC m=+22.703169030" watchObservedRunningTime="2026-06-06 18:59:04.8421929 +0000 UTC m=+23.631584685" Jun 06 18:59:04.842471 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.842446 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sw667" podStartSLOduration=4.017323265 podStartE2EDuration="22.842437962s" totalImagesPullingTime="18.825114697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:04.841795762 +0000 UTC m=+23.631187548" watchObservedRunningTime="2026-06-06 18:59:04.842437962 +0000 UTC m=+23.631829747" Jun 06 18:59:04.851879 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:04.851861 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:59:05.712124 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:05.712096 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:05.712402 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:05.712205 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:05.712402 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:05.712213 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:05.712402 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:05.712304 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:05.712402 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:05.712212 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:05.712589 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:05.712407 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:06.100649 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.100621 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:59:06.101291 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.101274 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:59:06.840253 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.840067 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" event={"ID":"b28012c7-6a5d-4786-8b0f-f8768204271b","Type":"ContainerStarted","Data":"6d07d14420c6c68e3385d48e021ae383dbd58726b56536a55f5ddccf11b87de5"} Jun 06 18:59:06.843644 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.843625 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 18:59:06.844060 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.844034 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"e67a63b3abf8136b4ea7102fca70c2b999b115665f546692fc4bacc13a41fe23"} Jun 06 18:59:06.844765 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.844742 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-chccm" Jun 06 18:59:06.858593 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:06.858543 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5kbzw" podStartSLOduration=3.567019536 podStartE2EDuration="24.858530094s" totalImagesPullingTime="21.291510558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:06.858423775 +0000 UTC m=+25.647815561" watchObservedRunningTime="2026-06-06 18:59:06.858530094 +0000 UTC m=+25.647921876" Jun 06 18:59:07.709037 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:07.708994 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:07.709037 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:07.709025 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:07.709681 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:07.708995 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:07.709681 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:07.709126 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:07.709681 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:07.709205 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:07.709681 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:07.709317 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:08.850666 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:08.850313 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="6970df0d22951633de9186337adb5d883a003d5d9558fff182dee5798ab32d1b" exitCode=0 Jun 06 18:59:08.850666 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:08.850395 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"6970df0d22951633de9186337adb5d883a003d5d9558fff182dee5798ab32d1b"} Jun 06 18:59:08.854014 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:08.853996 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 18:59:08.854388 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:08.854369 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"194732b0e882edf17e9d2a86e5c449e78e9713b14bd0718243ad0a054cd7fb9f"} Jun 06 18:59:08.854847 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:08.854832 2548 scope.go:117] "RemoveContainer" containerID="e877b1d08ee3532daf0c2c4d31ebb7a45c51479fcbe59f6646a3d9c8f051aa7b" Jun 06 18:59:09.710300 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.710244 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:09.710629 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:09.710390 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:09.710629 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.710502 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:09.710629 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.710532 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:09.710629 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:09.710614 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:09.710906 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:09.710686 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:09.861098 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.861075 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 18:59:09.861475 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.861455 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" event={"ID":"02d13a65-10eb-4c32-8632-1975a236cf38","Type":"ContainerStarted","Data":"4c95a14d79de31747c4096b72087a3caea65473d43ea1792cc6d496f0ac25fcb"} Jun 06 18:59:09.861831 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.861810 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:09.861942 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.861904 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:09.861994 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.861957 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:09.882951 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.882926 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:09.883172 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.883124 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:09.897766 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:09.897721 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" podStartSLOduration=9.736493253999999 podStartE2EDuration="28.897706275s" totalImagesPullingTime="19.161213021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:09.896076795 +0000 UTC m=+28.685468579" watchObservedRunningTime="2026-06-06 18:59:09.897706275 +0000 UTC m=+28.687098100" Jun 06 18:59:10.531288 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.531254 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdtk2"] Jun 06 18:59:10.531452 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.531368 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:10.531503 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:10.531455 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:10.534138 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.534109 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dmrz"] Jun 06 18:59:10.534274 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.534226 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:10.534367 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:10.534344 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:10.534896 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.534873 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2qqk"] Jun 06 18:59:10.534985 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.534952 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:10.535065 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:10.535045 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:10.865615 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.865511 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="a57534ba585f520d47d19b4b2f3f463556225546b49d588b8b4ad8b0903bacc0" exitCode=0 Jun 06 18:59:10.865615 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:10.865590 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"a57534ba585f520d47d19b4b2f3f463556225546b49d588b8b4ad8b0903bacc0"} Jun 06 18:59:11.709725 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:11.709694 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:11.709909 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:11.709769 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:11.709909 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:11.709785 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:11.709909 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:11.709872 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:12.709076 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:12.709044 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:12.709437 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:12.709154 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:12.873084 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:12.872996 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="9931fcd117e79545822e558f56790418e3a8d9e24784c940f7bd04e908dea786" exitCode=0 Jun 06 18:59:12.873084 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:12.873053 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"9931fcd117e79545822e558f56790418e3a8d9e24784c940f7bd04e908dea786"} Jun 06 18:59:13.709140 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:13.708912 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:13.709661 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:13.708980 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:13.709661 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:13.709253 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:13.709661 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:13.709414 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:14.708429 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:14.708398 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:14.708628 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:14.708521 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:15.410903 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:15.410867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:15.411354 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.411015 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:59:15.411354 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.411077 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:47.411061881 +0000 UTC m=+66.200453647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 18:59:15.511777 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:15.511735 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:15.511950 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.511904 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 18:59:15.511998 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.511983 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret podName:e70f01f5-9263-4184-9615-d3f5c853eab2 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:47.511961324 +0000 UTC m=+66.301353104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret") pod "global-pull-secret-syncer-fdtk2" (UID: "e70f01f5-9263-4184-9615-d3f5c853eab2") : object "kube-system"/"original-pull-secret" not registered Jun 06 18:59:15.613025 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:15.612991 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:15.613182 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.613124 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 18:59:15.613182 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.613138 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 18:59:15.613182 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.613146 2548 projected.go:196] Error preparing data for projected volume kube-api-access-nb656 for pod openshift-network-diagnostics/network-check-target-n2qqk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:59:15.613277 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.613192 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656 podName:511742cb-a14a-49c0-9e58-b5a723538d7c nodeName:}" failed. No retries permitted until 2026-06-06 18:59:47.613180259 +0000 UTC m=+66.402572021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb656" (UniqueName: "kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656") pod "network-check-target-n2qqk" (UID: "511742cb-a14a-49c0-9e58-b5a723538d7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 18:59:15.709136 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:15.709054 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:15.709272 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:15.709077 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:15.709272 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.709184 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qqk" podUID="511742cb-a14a-49c0-9e58-b5a723538d7c" Jun 06 18:59:15.709272 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:15.709219 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtk2" podUID="e70f01f5-9263-4184-9615-d3f5c853eab2" Jun 06 18:59:16.709205 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:16.709170 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:16.709702 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:16.709289 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 18:59:16.995270 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:16.995243 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeReady" Jun 06 18:59:16.995427 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:16.995373 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 18:59:17.027775 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.027738 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 18:59:17.032623 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.032602 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.034999 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.034974 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rt55d\"" Jun 06 18:59:17.035124 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.035022 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 18:59:17.035124 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.034987 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 18:59:17.035755 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.035737 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 18:59:17.037721 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.037700 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ktxws"] Jun 06 18:59:17.040890 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.040864 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jgjl7"] Jun 06 18:59:17.041013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.040993 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.041451 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.041434 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 18:59:17.043843 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.043822 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqxk9\"" Jun 06 18:59:17.043944 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.043847 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 18:59:17.043944 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.043853 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 18:59:17.044491 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.044474 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.044607 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.044577 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 18:59:17.046611 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.046590 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 18:59:17.046878 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.046858 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 18:59:17.047006 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.046991 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lxrss\"" Jun 06 18:59:17.047072 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.047060 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 18:59:17.050281 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.050257 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ktxws"] Jun 06 18:59:17.053213 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.053158 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgjl7"] Jun 06 18:59:17.123670 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.123670 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123669 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123696 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123725 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123818 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-cert\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123852 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvdw\" (UniqueName: \"kubernetes.io/projected/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-kube-api-access-8gvdw\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123883 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.123926 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123923 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7srg\" (UniqueName: \"kubernetes.io/projected/52bf4dee-5e9a-4856-8755-988585d65388-kube-api-access-g7srg\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.124199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123956 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.124199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.123998 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhhmw\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.124199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.124034 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52bf4dee-5e9a-4856-8755-988585d65388-config-volume\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.124199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.124071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.124199 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.124184 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.124424 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.124213 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52bf4dee-5e9a-4856-8755-988585d65388-tmp-dir\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.225552 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225511 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7srg\" (UniqueName: \"kubernetes.io/projected/52bf4dee-5e9a-4856-8755-988585d65388-kube-api-access-g7srg\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.225738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225586 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225613 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhhmw\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225639 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52bf4dee-5e9a-4856-8755-988585d65388-config-volume\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.225738 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225664 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225741 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225765 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52bf4dee-5e9a-4856-8755-988585d65388-tmp-dir\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225793 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225816 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225838 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225864 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225890 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-cert\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225917 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvdw\" (UniqueName: \"kubernetes.io/projected/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-kube-api-access-8gvdw\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.225960 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.225949 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.226695 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.226408 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.226695 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.226429 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52bf4dee-5e9a-4856-8755-988585d65388-config-volume\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.226695 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.226498 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:17.226695 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.226529 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.226695 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.226592 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:17.726549762 +0000 UTC m=+36.515941543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:17.227059 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.226719 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:17.227059 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.226734 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:17.227059 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.226731 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52bf4dee-5e9a-4856-8755-988585d65388-tmp-dir\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.227059 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.226788 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:17.726773024 +0000 UTC m=+36.516164800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:17.227208 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.227068 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.230743 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.230724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.230743 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.230730 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.230909 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.230805 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-cert\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.233132 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.233111 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7srg\" (UniqueName: \"kubernetes.io/projected/52bf4dee-5e9a-4856-8755-988585d65388-kube-api-access-g7srg\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.236636 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.236600 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhhmw\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.236747 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.236727 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.236913 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.236822 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvdw\" (UniqueName: \"kubernetes.io/projected/c9a88ecd-f049-4ee9-97e4-3bd47283aa52-kube-api-access-8gvdw\") pod \"ingress-canary-jgjl7\" (UID: \"c9a88ecd-f049-4ee9-97e4-3bd47283aa52\") " pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.361851 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.361777 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgjl7" Jun 06 18:59:17.612872 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.612625 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgjl7"] Jun 06 18:59:17.709096 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.709057 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:17.709253 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.709062 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:17.711415 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.711374 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 18:59:17.711547 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.711449 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 18:59:17.711547 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.711510 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p7hm\"" Jun 06 18:59:17.711693 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.711455 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 18:59:17.728832 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.728804 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:17.728953 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.728851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:17.729008 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.728984 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:17.729008 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.728997 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:17.729105 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.729036 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:17.729105 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.729080 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:18.729060344 +0000 UTC m=+37.518452110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:17.729105 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:17.729096 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:18.729089549 +0000 UTC m=+37.518481311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:17.888632 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.888527 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="c5c4f555d8b4c7b9b8c681c596335fbb14ed5e9c3fc77be403320ac477d38324" exitCode=0 Jun 06 18:59:17.888632 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.888620 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"c5c4f555d8b4c7b9b8c681c596335fbb14ed5e9c3fc77be403320ac477d38324"} Jun 06 18:59:17.889741 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:17.889721 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgjl7" event={"ID":"c9a88ecd-f049-4ee9-97e4-3bd47283aa52","Type":"ContainerStarted","Data":"b6e8b307e230a9adc884b04e2535e740c143666c6d82b7e12e7601a8806d6081"} Jun 06 18:59:18.708577 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.708492 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:18.711128 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.711096 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 18:59:18.711507 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.711109 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-csbp9\"" Jun 06 18:59:18.738521 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.738485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:18.738521 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.738526 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:18.738746 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:18.738667 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:18.738746 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:18.738683 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:18.738852 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:18.738750 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:20.738731493 +0000 UTC m=+39.528123272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:18.738852 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:18.738747 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:18.738852 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:18.738812 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:20.738794995 +0000 UTC m=+39.528186763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:18.896086 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.896049 2548 generic.go:356] "Generic (PLEG): container finished" podID="6f45eb81-42b9-4309-a496-6dc1cdf88b8e" containerID="a6c881095a097df688a89681d313e4f27ddc108d470d0c187b67436a23dbb657" exitCode=0 Jun 06 18:59:18.896264 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:18.896093 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerDied","Data":"a6c881095a097df688a89681d313e4f27ddc108d470d0c187b67436a23dbb657"} Jun 06 18:59:19.901832 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:19.901799 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" event={"ID":"6f45eb81-42b9-4309-a496-6dc1cdf88b8e","Type":"ContainerStarted","Data":"444987b822957e2e737b7f1e4bce85fed47ee05a1aebf16f160d3f069472a141"} Jun 06 18:59:19.933166 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:19.933103 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppgtq" podStartSLOduration=7.970232098 podStartE2EDuration="37.933082099s" totalImagesPullingTime="29.962850001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:19.933035095 +0000 UTC m=+38.722426904" watchObservedRunningTime="2026-06-06 18:59:19.933082099 +0000 UTC m=+38.722473883" Jun 06 18:59:20.075211 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.075176 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:20.151812 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.151772 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:20.755950 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.755912 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:20.755950 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.755953 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:20.756162 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:20.756052 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:20.756162 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:20.756060 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:20.756162 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:20.756080 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:20.756162 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:20.756105 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:24.756090504 +0000 UTC m=+43.545482266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:20.756162 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:20.756118 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:24.75611161 +0000 UTC m=+43.545503372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:20.905262 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.905224 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgjl7" event={"ID":"c9a88ecd-f049-4ee9-97e4-3bd47283aa52","Type":"ContainerStarted","Data":"e34a5187a92971b6e45b27710c964b588579c79aef2bc7b9a2fb297ac188531b"} Jun 06 18:59:20.921521 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:20.921472 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jgjl7" podStartSLOduration=1.631254766 podStartE2EDuration="3.921453557s" totalImagesPullingTime="2.290198791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:20.920978042 +0000 UTC m=+39.710369839" watchObservedRunningTime="2026-06-06 18:59:20.921453557 +0000 UTC m=+39.710845319" Jun 06 18:59:21.438449 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:21.438423 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:21.546548 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:21.546519 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:21.647438 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:21.647404 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:24.205018 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:24.204987 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:24.782021 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:24.781982 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:24.782021 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:24.782022 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:24.782218 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:24.782133 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:24.782218 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:24.782191 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:32.782177156 +0000 UTC m=+51.571568923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:24.782288 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:24.782137 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:24.782288 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:24.782241 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:24.782352 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:24.782293 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:32.78227928 +0000 UTC m=+51.571671046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:28.617034 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:28.616988 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:28.669412 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:28.669384 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:29.054817 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:29.054784 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:29.105572 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:29.105535 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:29.380418 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:29.380340 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:29.437391 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:29.437360 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:32.841265 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:32.841231 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:32.841265 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:32.841268 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:32.841789 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:32.841387 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:32.841789 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:32.841405 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:32.841789 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:32.841426 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:32.841789 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:32.841472 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:48.841455111 +0000 UTC m=+67.630846873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:32.841789 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:32.841485 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 18:59:48.841479752 +0000 UTC m=+67.630871514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:41.877946 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:41.877922 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-245w2" Jun 06 18:59:42.030793 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:42.030744 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:42.131285 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:42.131211 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:44.537676 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:44.537644 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:44.588615 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:44.588587 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:47.446467 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.446433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 18:59:47.449070 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.449050 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 18:59:47.457080 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:47.457063 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 18:59:47.457145 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:47.457123 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 19:00:51.457106377 +0000 UTC m=+130.246498138 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : secret "metrics-daemon-secret" not found Jun 06 18:59:47.546811 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.546783 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:47.549268 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.549254 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 18:59:47.560762 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.560740 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e70f01f5-9263-4184-9615-d3f5c853eab2-original-pull-secret\") pod \"global-pull-secret-syncer-fdtk2\" (UID: \"e70f01f5-9263-4184-9615-d3f5c853eab2\") " pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:47.647234 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.647208 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:47.650013 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.649995 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 18:59:47.660407 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.660387 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 18:59:47.670661 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.670638 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb656\" (UniqueName: \"kubernetes.io/projected/511742cb-a14a-49c0-9e58-b5a723538d7c-kube-api-access-nb656\") pod \"network-check-target-n2qqk\" (UID: \"511742cb-a14a-49c0-9e58-b5a723538d7c\") " pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:47.721659 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.721639 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p7hm\"" Jun 06 18:59:47.724459 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.724446 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtk2" Jun 06 18:59:47.729606 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.729588 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:47.900135 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.900096 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdtk2"] Jun 06 18:59:47.903585 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:59:47.903533 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70f01f5_9263_4184_9615_d3f5c853eab2.slice/crio-c6c573d0a2288cf083b9ee1808c233a299cc0a27fc58fad46e9105ed74a5617c WatchSource:0}: Error finding container c6c573d0a2288cf083b9ee1808c233a299cc0a27fc58fad46e9105ed74a5617c: Status 404 returned error can't find the container with id c6c573d0a2288cf083b9ee1808c233a299cc0a27fc58fad46e9105ed74a5617c Jun 06 18:59:47.915042 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.915014 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2qqk"] Jun 06 18:59:47.919246 ip-10-0-130-40 kubenswrapper[2548]: W0606 18:59:47.919223 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511742cb_a14a_49c0_9e58_b5a723538d7c.slice/crio-21ee910d5fc026b2e2e1d59549b83581694a00e123f61ec34a7703c3fcbfa9ea WatchSource:0}: Error finding container 21ee910d5fc026b2e2e1d59549b83581694a00e123f61ec34a7703c3fcbfa9ea: Status 404 returned error can't find the container with id 21ee910d5fc026b2e2e1d59549b83581694a00e123f61ec34a7703c3fcbfa9ea Jun 06 18:59:47.968550 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.968525 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2qqk" event={"ID":"511742cb-a14a-49c0-9e58-b5a723538d7c","Type":"ContainerStarted","Data":"21ee910d5fc026b2e2e1d59549b83581694a00e123f61ec34a7703c3fcbfa9ea"} Jun 06 18:59:47.969521 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:47.969499 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdtk2" event={"ID":"e70f01f5-9263-4184-9615-d3f5c853eab2","Type":"ContainerStarted","Data":"c6c573d0a2288cf083b9ee1808c233a299cc0a27fc58fad46e9105ed74a5617c"} Jun 06 18:59:48.860402 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:48.860361 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:48.860410 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:48.860529 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:48.860569 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:48.860581 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:48.860635 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 19:00:20.860614099 +0000 UTC m=+99.650005863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 18:59:48.860877 ip-10-0-130-40 kubenswrapper[2548]: E0606 18:59:48.860655 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 19:00:20.860645627 +0000 UTC m=+99.650037389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 18:59:52.985352 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:52.985317 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:52.985831 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:52.985423 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2qqk" event={"ID":"511742cb-a14a-49c0-9e58-b5a723538d7c","Type":"ContainerStarted","Data":"966b6d47888382d0b771b0ba7c7b965736ba6e988b7975ed6bdeeecb5c07e32c"} Jun 06 18:59:52.985831 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:52.985540 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 18:59:52.986849 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:52.986830 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdtk2" event={"ID":"e70f01f5-9263-4184-9615-d3f5c853eab2","Type":"ContainerStarted","Data":"b6d8277e3a24d0a4d0465ac78f2d35e44829f8a3227724a0412a97b813a0ef3f"} Jun 06 18:59:53.000922 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:53.000884 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2qqk" podStartSLOduration=66.439487256 podStartE2EDuration="1m11.000872805s" totalImagesPullingTime="4.561385549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:53.000207014 +0000 UTC m=+71.789598831" watchObservedRunningTime="2026-06-06 18:59:53.000872805 +0000 UTC m=+71.790264588" Jun 06 18:59:53.016552 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:53.016515 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdtk2" podStartSLOduration=66.434258424 podStartE2EDuration="1m11.016506415s" totalImagesPullingTime="4.582247991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 18:59:53.016032356 +0000 UTC m=+71.805424141" watchObservedRunningTime="2026-06-06 18:59:53.016506415 +0000 UTC m=+71.805898227" Jun 06 18:59:53.086456 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:53.086406 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:53.135646 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:53.135619 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:57.186647 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:57.186613 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 18:59:57.234814 ip-10-0-130-40 kubenswrapper[2548]: I0606 18:59:57.234778 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:00:19.340145 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:00:19.340040 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:00:20.881195 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:00:20.881145 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:00:20.881257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:20.881306 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:20.881361 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:20.881373 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:20.881380 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 19:01:24.88135975 +0000 UTC m=+163.670751525 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 19:00:20.881614 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:20.881416 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 19:01:24.881405911 +0000 UTC m=+163.670797678 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 19:00:23.991284 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:00:23.991250 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2qqk" Jun 06 19:00:51.499314 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:00:51.499269 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:00:51.499842 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:51.499411 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 19:00:51.499842 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:00:51.499483 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:53.499462991 +0000 UTC m=+252.288854757 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : secret "metrics-daemon-secret" not found Jun 06 19:01:20.044049 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:20.043997 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" Jun 06 19:01:20.055133 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:20.055107 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ktxws" podUID="52bf4dee-5e9a-4856-8755-988585d65388" Jun 06 19:01:20.192475 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:01:20.192451 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:01:20.192602 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:01:20.192451 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktxws" Jun 06 19:01:21.718493 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:21.718461 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 19:01:24.925741 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:01:24.925687 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:01:24.925741 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:01:24.925740 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 19:01:24.926188 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:24.925831 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 19:01:24.926188 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:24.925853 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b785f5b75-zsrpm: secret "image-registry-tls" not found Jun 06 19:01:24.926188 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:24.925837 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 19:01:24.926188 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:24.925910 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls podName:30f10034-e153-4d1b-ad85-406a45c30a60 nodeName:}" failed. No retries permitted until 2026-06-06 19:03:26.925894518 +0000 UTC m=+285.715286280 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls") pod "image-registry-b785f5b75-zsrpm" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60") : secret "image-registry-tls" not found Jun 06 19:01:24.926188 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:01:24.925923 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls podName:52bf4dee-5e9a-4856-8755-988585d65388 nodeName:}" failed. No retries permitted until 2026-06-06 19:03:26.925917226 +0000 UTC m=+285.715308987 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls") pod "dns-default-ktxws" (UID: "52bf4dee-5e9a-4856-8755-988585d65388") : secret "dns-default-metrics-tls" not found Jun 06 19:01:36.708674 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:01:36.708583 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:02:06.587462 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:06.587432 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:37.448801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.448769 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg"] Jun 06 19:02:37.450306 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.450290 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6"] Jun 06 19:02:37.450422 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.450403 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.452133 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.452112 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-nbblc"] Jun 06 19:02:37.452245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.452229 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.452905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.452882 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l9qvg\"" Jun 06 19:02:37.453016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.452907 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 06 19:02:37.453016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.452943 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 06 19:02:37.453117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.453072 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 06 19:02:37.453197 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.453181 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 06 19:02:37.454054 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.454035 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.454491 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.454471 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 06 19:02:37.454620 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.454603 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 06 19:02:37.454707 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.454694 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 06 19:02:37.455072 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.455056 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 06 19:02:37.455072 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.455064 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lbvdx\"" Jun 06 19:02:37.456567 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.456538 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 19:02:37.456652 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.456551 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k2l5h\"" Jun 06 19:02:37.457294 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.457229 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 19:02:37.457294 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.457262 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 19:02:37.457407 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.457387 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 19:02:37.465659 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.465627 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg"] Jun 06 19:02:37.465900 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.465882 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 19:02:37.466398 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.466377 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6"] Jun 06 19:02:37.467485 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.467458 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nbblc"] Jun 06 19:02:37.512245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512221 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7cd\" (UniqueName: \"kubernetes.io/projected/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-kube-api-access-tw7cd\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.512346 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512270 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5s9r\" (UniqueName: \"kubernetes.io/projected/03214659-182f-4a11-a9bf-3b0d42462df5-kube-api-access-p5s9r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.512346 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.512346 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512325 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03214659-182f-4a11-a9bf-3b0d42462df5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.512486 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512346 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-config\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.512486 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.512370 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03214659-182f-4a11-a9bf-3b0d42462df5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.541293 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.541269 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq"] Jun 06 19:02:37.542933 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.542920 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" Jun 06 19:02:37.544694 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.544674 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk"] Jun 06 19:02:37.545729 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.545706 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 19:02:37.546102 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.546085 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 19:02:37.546179 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.546085 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q9wsl\"" Jun 06 19:02:37.546473 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.546458 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl"] Jun 06 19:02:37.546607 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.546591 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" Jun 06 19:02:37.548456 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.548440 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-895zv"] Jun 06 19:02:37.548589 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.548575 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.548806 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.548788 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w2kvp\"" Jun 06 19:02:37.550116 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.550101 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.550952 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.550936 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 19:02:37.551169 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.551155 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2rm7w\"" Jun 06 19:02:37.551283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.551268 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 19:02:37.551355 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.551290 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 19:02:37.552237 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.552217 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 06 19:02:37.552319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.552242 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vsplg\"" Jun 06 19:02:37.552319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.552291 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 06 19:02:37.555481 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.555464 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq"] Jun 06 19:02:37.566549 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.566526 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk"] Jun 06 19:02:37.567273 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.567254 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl"] Jun 06 19:02:37.594277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.594253 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-895zv"] Jun 06 19:02:37.613695 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613673 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7cd\" (UniqueName: \"kubernetes.io/projected/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-kube-api-access-tw7cd\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.613767 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613700 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.613767 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613720 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df78t\" (UniqueName: \"kubernetes.io/projected/d540a8b2-944f-4d99-9672-8edc462e4d11-kube-api-access-df78t\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.613767 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613750 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.613882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613780 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e75363e-d603-4e5d-952a-8cdc70f71a18-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.613882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613813 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03214659-182f-4a11-a9bf-3b0d42462df5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.613882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613833 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03214659-182f-4a11-a9bf-3b0d42462df5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.613882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613848 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-service-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.613882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613875 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-serving-cert\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.614130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613971 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-snapshots\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.614130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.613989 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-trusted-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.614130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614009 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk5db\" (UniqueName: \"kubernetes.io/projected/38523dc9-48b0-48c7-8844-57d835fe7d37-kube-api-access-fk5db\") pod \"network-check-source-dbd9cf844-4t2gk\" (UID: \"38523dc9-48b0-48c7-8844-57d835fe7d37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" Jun 06 19:02:37.614130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614035 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.614130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614088 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5s9r\" (UniqueName: \"kubernetes.io/projected/03214659-182f-4a11-a9bf-3b0d42462df5-kube-api-access-p5s9r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.614380 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614202 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-config\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.614380 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614232 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xfg\" (UniqueName: \"kubernetes.io/projected/24c4b8bd-9844-4143-9b36-fee2d960e314-kube-api-access-n7xfg\") pod \"volume-data-source-validator-78dd696465-4d5nq\" (UID: \"24c4b8bd-9844-4143-9b36-fee2d960e314\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" Jun 06 19:02:37.614380 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614290 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnhq\" (UniqueName: \"kubernetes.io/projected/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-kube-api-access-vtnhq\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.614380 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614309 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-tmp\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.614527 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614432 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03214659-182f-4a11-a9bf-3b0d42462df5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.614811 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.614792 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-config\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.616095 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.616073 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.616322 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.616303 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03214659-182f-4a11-a9bf-3b0d42462df5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.621233 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.621213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5s9r\" (UniqueName: \"kubernetes.io/projected/03214659-182f-4a11-a9bf-3b0d42462df5-kube-api-access-p5s9r\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-2qjr6\" (UID: \"03214659-182f-4a11-a9bf-3b0d42462df5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.621623 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.621607 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7cd\" (UniqueName: \"kubernetes.io/projected/98b9da27-7a6d-4d56-a7d4-21eb40853ec1-kube-api-access-tw7cd\") pod \"service-ca-operator-6bc5ff68f5-9r6dg\" (UID: \"98b9da27-7a6d-4d56-a7d4-21eb40853ec1\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.715621 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715552 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-snapshots\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.715621 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715595 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-trusted-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.715621 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715614 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk5db\" (UniqueName: \"kubernetes.io/projected/38523dc9-48b0-48c7-8844-57d835fe7d37-kube-api-access-fk5db\") pod \"network-check-source-dbd9cf844-4t2gk\" (UID: \"38523dc9-48b0-48c7-8844-57d835fe7d37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715642 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715662 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xfg\" (UniqueName: \"kubernetes.io/projected/24c4b8bd-9844-4143-9b36-fee2d960e314-kube-api-access-n7xfg\") pod \"volume-data-source-validator-78dd696465-4d5nq\" (UID: \"24c4b8bd-9844-4143-9b36-fee2d960e314\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:37.715764 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:37.715845 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls podName:d540a8b2-944f-4d99-9672-8edc462e4d11 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:38.215826947 +0000 UTC m=+237.005218716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4r5tl" (UID: "d540a8b2-944f-4d99-9672-8edc462e4d11") : secret "samples-operator-tls" not found Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715866 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnhq\" (UniqueName: \"kubernetes.io/projected/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-kube-api-access-vtnhq\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.715911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715899 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-tmp\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715942 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df78t\" (UniqueName: \"kubernetes.io/projected/d540a8b2-944f-4d99-9672-8edc462e4d11-kube-api-access-df78t\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.715986 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716017 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e75363e-d603-4e5d-952a-8cdc70f71a18-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716047 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-service-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716070 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-snapshots\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:37.716139 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716168 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-serving-cert\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:37.716198 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:38.216185994 +0000 UTC m=+237.005577756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:37.716221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716214 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-tmp\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716678 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716540 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-trusted-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716678 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716545 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-service-ca-bundle\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.716802 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.716786 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e75363e-d603-4e5d-952a-8cdc70f71a18-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:37.718279 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.718262 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-serving-cert\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.724237 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.724213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df78t\" (UniqueName: \"kubernetes.io/projected/d540a8b2-944f-4d99-9672-8edc462e4d11-kube-api-access-df78t\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:37.724385 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.724365 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk5db\" (UniqueName: \"kubernetes.io/projected/38523dc9-48b0-48c7-8844-57d835fe7d37-kube-api-access-fk5db\") pod \"network-check-source-dbd9cf844-4t2gk\" (UID: \"38523dc9-48b0-48c7-8844-57d835fe7d37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" Jun 06 19:02:37.724756 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.724738 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnhq\" (UniqueName: \"kubernetes.io/projected/cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6-kube-api-access-vtnhq\") pod \"insights-operator-896549976-nbblc\" (UID: \"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6\") " pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.724899 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.724883 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xfg\" (UniqueName: \"kubernetes.io/projected/24c4b8bd-9844-4143-9b36-fee2d960e314-kube-api-access-n7xfg\") pod \"volume-data-source-validator-78dd696465-4d5nq\" (UID: \"24c4b8bd-9844-4143-9b36-fee2d960e314\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" Jun 06 19:02:37.728886 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.728843 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:37.760892 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.760872 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" Jun 06 19:02:37.773360 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.773343 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nbblc" Jun 06 19:02:37.777081 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.777057 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" Jun 06 19:02:37.832761 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.832730 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:37.853051 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.853019 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" Jun 06 19:02:37.860347 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.860322 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" Jun 06 19:02:37.902057 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.902021 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg"] Jun 06 19:02:37.995856 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:37.995823 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq"] Jun 06 19:02:37.998792 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:02:37.998760 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c4b8bd_9844_4143_9b36_fee2d960e314.slice/crio-ec922e4f9c104555834da869ffa7fe0e399e775aaca50cebd375a99786d62463 WatchSource:0}: Error finding container ec922e4f9c104555834da869ffa7fe0e399e775aaca50cebd375a99786d62463: Status 404 returned error can't find the container with id ec922e4f9c104555834da869ffa7fe0e399e775aaca50cebd375a99786d62463 Jun 06 19:02:38.012687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.012663 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk"] Jun 06 19:02:38.014950 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:02:38.014930 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38523dc9_48b0_48c7_8844_57d835fe7d37.slice/crio-93c0a17d673529b9c90bdb69d258f8762a3ca52dedd6b169cb7e2f4c1ac1dc1e WatchSource:0}: Error finding container 93c0a17d673529b9c90bdb69d258f8762a3ca52dedd6b169cb7e2f4c1ac1dc1e: Status 404 returned error can't find the container with id 93c0a17d673529b9c90bdb69d258f8762a3ca52dedd6b169cb7e2f4c1ac1dc1e Jun 06 19:02:38.129316 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.129274 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6"] Jun 06 19:02:38.136631 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.134087 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nbblc"] Jun 06 19:02:38.139149 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:02:38.139114 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3d215b_8d5a_4ec2_a7bb_5c5064dabaa6.slice/crio-28e32c313a8c4be9141c84760988763950e8412c2777fc3c17ef67f46fa22d8f WatchSource:0}: Error finding container 28e32c313a8c4be9141c84760988763950e8412c2777fc3c17ef67f46fa22d8f: Status 404 returned error can't find the container with id 28e32c313a8c4be9141c84760988763950e8412c2777fc3c17ef67f46fa22d8f Jun 06 19:02:38.220863 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.220835 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:38.220974 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.220926 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:38.221013 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:38.220984 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 19:02:38.221046 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:38.221030 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:38.221077 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:38.221046 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls podName:d540a8b2-944f-4d99-9672-8edc462e4d11 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:39.22102895 +0000 UTC m=+238.010420731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4r5tl" (UID: "d540a8b2-944f-4d99-9672-8edc462e4d11") : secret "samples-operator-tls" not found Jun 06 19:02:38.221116 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:38.221077 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:39.221061897 +0000 UTC m=+238.010453665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:38.371029 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.370994 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" event={"ID":"24c4b8bd-9844-4143-9b36-fee2d960e314","Type":"ContainerStarted","Data":"ec922e4f9c104555834da869ffa7fe0e399e775aaca50cebd375a99786d62463"} Jun 06 19:02:38.372288 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.372254 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" event={"ID":"03214659-182f-4a11-a9bf-3b0d42462df5","Type":"ContainerStarted","Data":"da06bfd0c04692bd09cfeb4ec0b9b51a1138477ec7ac788ea5dbda7f2abda054"} Jun 06 19:02:38.373780 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.373753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" event={"ID":"38523dc9-48b0-48c7-8844-57d835fe7d37","Type":"ContainerStarted","Data":"495f6fd8bc8f992b5db2611affd585544e0a3538075bd4652bbb4aaa16cd123a"} Jun 06 19:02:38.373897 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.373797 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" event={"ID":"38523dc9-48b0-48c7-8844-57d835fe7d37","Type":"ContainerStarted","Data":"93c0a17d673529b9c90bdb69d258f8762a3ca52dedd6b169cb7e2f4c1ac1dc1e"} Jun 06 19:02:38.375028 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.375005 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nbblc" event={"ID":"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6","Type":"ContainerStarted","Data":"28e32c313a8c4be9141c84760988763950e8412c2777fc3c17ef67f46fa22d8f"} Jun 06 19:02:38.376147 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.376105 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" event={"ID":"98b9da27-7a6d-4d56-a7d4-21eb40853ec1","Type":"ContainerStarted","Data":"6db4495ad239eedd061d9dfb90ed5fd8a077c05a28532648d663f3dda64b5a44"} Jun 06 19:02:38.390508 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:38.390463 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-4t2gk" podStartSLOduration=1.390446136 podStartE2EDuration="1.390446136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:38.389143486 +0000 UTC m=+237.178535271" watchObservedRunningTime="2026-06-06 19:02:38.390446136 +0000 UTC m=+237.179837900" Jun 06 19:02:39.230882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:39.230778 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:39.230882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:39.230882 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:39.231388 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:39.231044 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 19:02:39.231388 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:39.231108 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls podName:d540a8b2-944f-4d99-9672-8edc462e4d11 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:41.231088807 +0000 UTC m=+240.020480572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4r5tl" (UID: "d540a8b2-944f-4d99-9672-8edc462e4d11") : secret "samples-operator-tls" not found Jun 06 19:02:39.231633 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:39.231526 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:39.231633 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:39.231604 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:41.231586536 +0000 UTC m=+240.020978302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:40.384668 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:40.384629 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" event={"ID":"24c4b8bd-9844-4143-9b36-fee2d960e314","Type":"ContainerStarted","Data":"94bc1c3da81441a66ee9a7a2e1647db5d4b6df8ad8019945f683aad203dd745d"} Jun 06 19:02:40.401002 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:40.400947 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4d5nq" podStartSLOduration=2.065639239 podStartE2EDuration="3.400926165s" totalImagesPullingTime="1.335286926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:40.399514938 +0000 UTC m=+239.188906722" watchObservedRunningTime="2026-06-06 19:02:40.400926165 +0000 UTC m=+239.190317949" Jun 06 19:02:40.470924 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:40.470882 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:40.571164 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:40.571128 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:41.250673 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.250574 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:41.250829 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.250679 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:41.250829 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:41.250722 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:41.250829 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:41.250801 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:45.250778144 +0000 UTC m=+244.040169921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:41.250829 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:41.250805 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 19:02:41.250991 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:41.250853 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls podName:d540a8b2-944f-4d99-9672-8edc462e4d11 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:45.250838625 +0000 UTC m=+244.040230394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4r5tl" (UID: "d540a8b2-944f-4d99-9672-8edc462e4d11") : secret "samples-operator-tls" not found Jun 06 19:02:41.390428 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.390395 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" event={"ID":"03214659-182f-4a11-a9bf-3b0d42462df5","Type":"ContainerStarted","Data":"70ea5b3e9b208aba5ac5662e06a3951249115bc5ef4a0f2315697bee11fdf668"} Jun 06 19:02:41.392426 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.392397 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nbblc" event={"ID":"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6","Type":"ContainerStarted","Data":"8077458f0bf9029eb98aef5a69753fe9d13b70bf27259a875aabbf8ece91cdc9"} Jun 06 19:02:41.394005 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.393972 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" event={"ID":"98b9da27-7a6d-4d56-a7d4-21eb40853ec1","Type":"ContainerStarted","Data":"e0996e50daafe79fb09194bf0b2ae114256af4b19357151f2b245470e4dc0d70"} Jun 06 19:02:41.406232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.406190 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" podStartSLOduration=1.547112915 podStartE2EDuration="4.406174201s" totalImagesPullingTime="2.859061286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:41.405609064 +0000 UTC m=+240.195000851" watchObservedRunningTime="2026-06-06 19:02:41.406174201 +0000 UTC m=+240.195565985" Jun 06 19:02:41.419773 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.419735 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" podStartSLOduration=1.335524141 podStartE2EDuration="4.419725976s" totalImagesPullingTime="3.084201835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:41.419421619 +0000 UTC m=+240.208813406" watchObservedRunningTime="2026-06-06 19:02:41.419725976 +0000 UTC m=+240.209117803" Jun 06 19:02:41.436697 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.436639 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-nbblc" podStartSLOduration=1.579826038 podStartE2EDuration="4.436619393s" totalImagesPullingTime="2.856793355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:41.436162283 +0000 UTC m=+240.225554077" watchObservedRunningTime="2026-06-06 19:02:41.436619393 +0000 UTC m=+240.226011211" Jun 06 19:02:41.962780 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:41.962742 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.013771 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.013742 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.092845 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.092817 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.133485 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.133452 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d"] Jun 06 19:02:42.136177 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.136157 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" Jun 06 19:02:42.138571 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.138531 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 06 19:02:42.138681 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.138592 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lkhvx\"" Jun 06 19:02:42.138681 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.138531 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 06 19:02:42.145638 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.145618 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d"] Jun 06 19:02:42.187960 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.187936 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.240319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.240292 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.259191 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.259154 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wd5m\" (UniqueName: \"kubernetes.io/projected/b6101196-9b64-4b10-b650-0b369cac8be7-kube-api-access-6wd5m\") pod \"migrator-955ffdf5f-wxg6d\" (UID: \"b6101196-9b64-4b10-b650-0b369cac8be7\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" Jun 06 19:02:42.290624 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.290592 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.360182 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.360146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wd5m\" (UniqueName: \"kubernetes.io/projected/b6101196-9b64-4b10-b650-0b369cac8be7-kube-api-access-6wd5m\") pod \"migrator-955ffdf5f-wxg6d\" (UID: \"b6101196-9b64-4b10-b650-0b369cac8be7\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" Jun 06 19:02:42.367382 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.367359 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wd5m\" (UniqueName: \"kubernetes.io/projected/b6101196-9b64-4b10-b650-0b369cac8be7-kube-api-access-6wd5m\") pod \"migrator-955ffdf5f-wxg6d\" (UID: \"b6101196-9b64-4b10-b650-0b369cac8be7\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" Jun 06 19:02:42.446100 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.446063 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" Jun 06 19:02:42.567594 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.567548 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d"] Jun 06 19:02:42.570302 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:02:42.570274 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6101196_9b64_4b10_b650_0b369cac8be7.slice/crio-0eeea7809a9b77ff68787a4089c0f8818bcb7a9c04e2baf04b4283c11e0ceb38 WatchSource:0}: Error finding container 0eeea7809a9b77ff68787a4089c0f8818bcb7a9c04e2baf04b4283c11e0ceb38: Status 404 returned error can't find the container with id 0eeea7809a9b77ff68787a4089c0f8818bcb7a9c04e2baf04b4283c11e0ceb38 Jun 06 19:02:42.765039 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.764974 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:42.865579 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:42.865531 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:43.401931 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:43.401897 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" event={"ID":"b6101196-9b64-4b10-b650-0b369cac8be7","Type":"ContainerStarted","Data":"0eeea7809a9b77ff68787a4089c0f8818bcb7a9c04e2baf04b4283c11e0ceb38"} Jun 06 19:02:43.703820 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:43.703792 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wlv8_666e7b91-e223-443f-97b7-ef94cba8be98/dns-node-resolver/0.log" Jun 06 19:02:44.365099 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.365066 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-shcgj"] Jun 06 19:02:44.368095 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.368073 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.370572 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.370533 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 06 19:02:44.370694 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.370594 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 06 19:02:44.370694 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.370611 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 06 19:02:44.371593 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.371578 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 06 19:02:44.371651 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.371615 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fx5d4\"" Jun 06 19:02:44.374942 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.374919 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-shcgj"] Jun 06 19:02:44.406915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.406870 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" event={"ID":"b6101196-9b64-4b10-b650-0b369cac8be7","Type":"ContainerStarted","Data":"58bbf0f09d608d955d75c57ad3c0fff4472fd219d402af061e1f1019967ea731"} Jun 06 19:02:44.406915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.406922 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" event={"ID":"b6101196-9b64-4b10-b650-0b369cac8be7","Type":"ContainerStarted","Data":"dc7e3e42ab9c83e5c2de81b7e58ef0ee8b2e1eb0dc52009f4ed6d400a07754c3"} Jun 06 19:02:44.421104 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.421045 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wxg6d" podStartSLOduration=1.322013887 podStartE2EDuration="2.421025059s" totalImagesPullingTime="1.099011172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:44.420709096 +0000 UTC m=+243.210100877" watchObservedRunningTime="2026-06-06 19:02:44.421025059 +0000 UTC m=+243.210416846" Jun 06 19:02:44.471175 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.471142 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:44.477311 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.477287 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-cabundle\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.477421 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.477334 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjcv\" (UniqueName: \"kubernetes.io/projected/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-kube-api-access-jfjcv\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.477463 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.477429 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-key\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.572509 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.572478 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:44.578751 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.578724 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-key\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.578870 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.578789 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-cabundle\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.578928 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.578869 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjcv\" (UniqueName: \"kubernetes.io/projected/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-kube-api-access-jfjcv\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.579534 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.579513 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-cabundle\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.581146 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.581130 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-signing-key\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.586940 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.586921 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjcv\" (UniqueName: \"kubernetes.io/projected/2653a2df-59ff-474c-bf4a-eb1ee5fc90e2-kube-api-access-jfjcv\") pod \"service-ca-7d74d578b8-shcgj\" (UID: \"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2\") " pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.677706 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.677625 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" Jun 06 19:02:44.804217 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.804184 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-shcgj"] Jun 06 19:02:44.807583 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:02:44.807537 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2653a2df_59ff_474c_bf4a_eb1ee5fc90e2.slice/crio-baa6ff152e5e77522cee33b3b416ae0526adca1c2f7c343ddd92694544f87066 WatchSource:0}: Error finding container baa6ff152e5e77522cee33b3b416ae0526adca1c2f7c343ddd92694544f87066: Status 404 returned error can't find the container with id baa6ff152e5e77522cee33b3b416ae0526adca1c2f7c343ddd92694544f87066 Jun 06 19:02:44.904908 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:44.904880 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wp28k_a03bc987-8ca6-4420-a52c-ece2d922af65/node-ca/0.log" Jun 06 19:02:45.243733 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.243699 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:45.286089 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.286041 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:45.286261 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.286146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:45.286261 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:45.286195 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:45.286338 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:45.286264 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:53.286247289 +0000 UTC m=+252.075639070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:45.286338 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:45.286286 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 19:02:45.286338 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:45.286336 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls podName:d540a8b2-944f-4d99-9672-8edc462e4d11 nodeName:}" failed. No retries permitted until 2026-06-06 19:02:53.28632281 +0000 UTC m=+252.075714572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4r5tl" (UID: "d540a8b2-944f-4d99-9672-8edc462e4d11") : secret "samples-operator-tls" not found Jun 06 19:02:45.411742 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.411703 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" event={"ID":"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2","Type":"ContainerStarted","Data":"d40de1f8c772fe92a8cf678a39f4aab77ea9d51797cfa46994742c319e2d9c2b"} Jun 06 19:02:45.411919 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.411766 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" event={"ID":"2653a2df-59ff-474c-bf4a-eb1ee5fc90e2","Type":"ContainerStarted","Data":"baa6ff152e5e77522cee33b3b416ae0526adca1c2f7c343ddd92694544f87066"} Jun 06 19:02:45.429679 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.429622 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-shcgj" podStartSLOduration=1.429602475 podStartE2EDuration="1.429602475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:45.428123602 +0000 UTC m=+244.217515386" watchObservedRunningTime="2026-06-06 19:02:45.429602475 +0000 UTC m=+244.218994260" Jun 06 19:02:45.703650 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:45.703569 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgjl7_c9a88ecd-f049-4ee9-97e4-3bd47283aa52/serve-healthcheck-canary/0.log" Jun 06 19:02:46.339105 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.339070 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:46.442752 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.442662 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:46.542677 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.542628 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:46.643154 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.643054 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:46.743538 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.743504 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:46.844839 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:46.844806 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:47.436413 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:47.436385 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:47.844949 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:47.844900 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:48.246266 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:48.246234 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:48.380701 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:48.380666 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:48.644927 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:48.644836 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:48.840292 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:48.840258 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:49.243831 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:49.243786 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.041247 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.041210 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.094826 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.094794 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.237683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.237652 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.436396 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.436316 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.641814 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.641781 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:50.845299 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:50.845269 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:51.236014 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:51.235989 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:51.708446 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:51.708360 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:51.841544 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:51.841508 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:52.240130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:52.240103 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:52.637140 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:52.637063 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:52.841229 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:52.841203 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:52.898595 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:52.898492 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:53.237393 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.237359 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:53.351299 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.351257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:02:53.351710 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.351361 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:53.351710 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:53.351408 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 19:02:53.351710 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:53.351476 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert podName:7e75363e-d603-4e5d-952a-8cdc70f71a18 nodeName:}" failed. No retries permitted until 2026-06-06 19:03:09.351455789 +0000 UTC m=+268.140847554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-895zv" (UID: "7e75363e-d603-4e5d-952a-8cdc70f71a18") : secret "networking-console-plugin-cert" not found Jun 06 19:02:53.353849 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.353823 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d540a8b2-944f-4d99-9672-8edc462e4d11-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4r5tl\" (UID: \"d540a8b2-944f-4d99-9672-8edc462e4d11\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:53.469570 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.469523 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2rm7w\"" Jun 06 19:02:53.477690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.477673 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" Jun 06 19:02:53.553198 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.553167 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:02:53.553345 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:53.553319 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 19:02:53.553391 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:02:53.553381 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs podName:7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0 nodeName:}" failed. No retries permitted until 2026-06-06 19:04:55.553365011 +0000 UTC m=+374.342756776 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs") pod "network-metrics-daemon-8dmrz" (UID: "7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0") : secret "metrics-daemon-secret" not found Jun 06 19:02:53.603252 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:53.603231 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl"] Jun 06 19:02:54.037693 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:54.037656 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:54.272165 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:54.272140 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:54.441468 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:54.441380 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" event={"ID":"d540a8b2-944f-4d99-9672-8edc462e4d11","Type":"ContainerStarted","Data":"56dcd93361edaf7af618ba517464e84f25a6fdc2bd5ecb855d6718ec9e700a5f"} Jun 06 19:02:54.642609 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:54.642580 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:54.840118 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:54.840087 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:55.035146 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:55.035112 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:55.445851 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:55.445817 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:56.037804 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.037766 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:56.245361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.245330 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:56.449042 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.448966 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:56.451156 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.451132 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" event={"ID":"d540a8b2-944f-4d99-9672-8edc462e4d11","Type":"ContainerStarted","Data":"ee0932d401a510ee2bbd4acb80cea024c8f438d1f29755923dadd1bff67ce550"} Jun 06 19:02:56.451271 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.451184 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" event={"ID":"d540a8b2-944f-4d99-9672-8edc462e4d11","Type":"ContainerStarted","Data":"911ba705f939c512fd1f8ef49c64489cd953ff76b2c323cde18a0bcbf40f837c"} Jun 06 19:02:56.465505 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.465458 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4r5tl" podStartSLOduration=17.56286846 podStartE2EDuration="19.465444869s" totalImagesPullingTime="1.902576409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:02:56.465110908 +0000 UTC m=+255.254502703" watchObservedRunningTime="2026-06-06 19:02:56.465444869 +0000 UTC m=+255.254836652" Jun 06 19:02:56.641692 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:56.641658 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:57.037329 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:57.037297 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:58.615524 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:58.615488 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:02:58.672741 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:02:58.672714 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.088552 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.088468 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.188937 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.188902 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.237676 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.237644 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.382764 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.382687 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.770331 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.770299 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:03.871145 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:03.871119 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.022056 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.021980 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7swpc"] Jun 06 19:03:04.025003 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.024988 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.028432 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.028413 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m9rvp\"" Jun 06 19:03:04.028432 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.028417 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 19:03:04.028603 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.028416 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 19:03:04.039154 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.039130 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7swpc"] Jun 06 19:03:04.105958 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.105924 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.130874 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.130845 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b78376-dc98-4466-93d0-41f697975388-crio-socket\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.130989 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.130900 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vj88\" (UniqueName: \"kubernetes.io/projected/10b78376-dc98-4466-93d0-41f697975388-kube-api-access-2vj88\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.130989 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.130947 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b78376-dc98-4466-93d0-41f697975388-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.131071 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.131015 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b78376-dc98-4466-93d0-41f697975388-data-volume\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.131071 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.131038 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b78376-dc98-4466-93d0-41f697975388-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.203305 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.203272 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.231940 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.231915 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b78376-dc98-4466-93d0-41f697975388-crio-socket\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.231965 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj88\" (UniqueName: \"kubernetes.io/projected/10b78376-dc98-4466-93d0-41f697975388-kube-api-access-2vj88\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232038 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b78376-dc98-4466-93d0-41f697975388-crio-socket\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232083 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b78376-dc98-4466-93d0-41f697975388-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232202 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b78376-dc98-4466-93d0-41f697975388-data-volume\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232233 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b78376-dc98-4466-93d0-41f697975388-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232489 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232467 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b78376-dc98-4466-93d0-41f697975388-data-volume\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.232723 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.232698 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b78376-dc98-4466-93d0-41f697975388-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.234502 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.234484 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b78376-dc98-4466-93d0-41f697975388-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.240905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.240885 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vj88\" (UniqueName: \"kubernetes.io/projected/10b78376-dc98-4466-93d0-41f697975388-kube-api-access-2vj88\") pod \"insights-runtime-extractor-7swpc\" (UID: \"10b78376-dc98-4466-93d0-41f697975388\") " pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.304729 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.304645 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.334407 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.334377 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7swpc" Jun 06 19:03:04.406256 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.406233 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.458810 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.458777 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7swpc"] Jun 06 19:03:04.463068 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:04.463021 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b78376_dc98_4466_93d0_41f697975388.slice/crio-cbfe3def359832b95857a764ab25c103aebe6bdf75985f209d148d9c5243d0b2 WatchSource:0}: Error finding container cbfe3def359832b95857a764ab25c103aebe6bdf75985f209d148d9c5243d0b2: Status 404 returned error can't find the container with id cbfe3def359832b95857a764ab25c103aebe6bdf75985f209d148d9c5243d0b2 Jun 06 19:03:04.479677 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.468854 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.487363 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.487338 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7swpc" event={"ID":"10b78376-dc98-4466-93d0-41f697975388","Type":"ContainerStarted","Data":"cbfe3def359832b95857a764ab25c103aebe6bdf75985f209d148d9c5243d0b2"} Jun 06 19:03:04.578613 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.578534 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.680284 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.680256 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.737916 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.737888 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.792182 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.792148 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:04.853007 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:04.852930 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:05.058220 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:05.058192 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:05.492823 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:05.492790 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7swpc" event={"ID":"10b78376-dc98-4466-93d0-41f697975388","Type":"ContainerStarted","Data":"55cd13cf4906806ec96dcbc11a00c2a782d6d32e3e74cad5a96e9a4ce7d934e9"} Jun 06 19:03:05.493203 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:05.492854 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7swpc" event={"ID":"10b78376-dc98-4466-93d0-41f697975388","Type":"ContainerStarted","Data":"36f4d4c7420b477a38c5c6d14c72b55e72469f141f2369798dd097df36a58904"} Jun 06 19:03:07.191977 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:07.191895 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:07.239930 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:07.239903 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:07.502355 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:07.502322 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7swpc" event={"ID":"10b78376-dc98-4466-93d0-41f697975388","Type":"ContainerStarted","Data":"84d7266204e90eda4a7c40b4347794800ad1f5bf14c3099b115cddbc814b145f"} Jun 06 19:03:07.519850 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:07.519788 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7swpc" podStartSLOduration=2.38180278 podStartE2EDuration="4.519774518s" totalImagesPullingTime="2.137971738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 19:03:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:07.519252286 +0000 UTC m=+266.308644090" watchObservedRunningTime="2026-06-06 19:03:07.519774518 +0000 UTC m=+266.309166301" Jun 06 19:03:09.375676 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:09.375639 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:03:09.377868 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:09.377850 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e75363e-d603-4e5d-952a-8cdc70f71a18-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-895zv\" (UID: \"7e75363e-d603-4e5d-952a-8cdc70f71a18\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:03:09.674863 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:09.674782 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vsplg\"" Jun 06 19:03:09.683081 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:09.683063 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" Jun 06 19:03:09.806063 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:09.806035 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-895zv"] Jun 06 19:03:09.809292 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:09.809265 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e75363e_d603_4e5d_952a_8cdc70f71a18.slice/crio-2d6f07cc2d5744a0e8649b4f4be897d9d749e707bd7da652b5334e34c175fc83 WatchSource:0}: Error finding container 2d6f07cc2d5744a0e8649b4f4be897d9d749e707bd7da652b5334e34c175fc83: Status 404 returned error can't find the container with id 2d6f07cc2d5744a0e8649b4f4be897d9d749e707bd7da652b5334e34c175fc83 Jun 06 19:03:10.512383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:10.512354 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" event={"ID":"7e75363e-d603-4e5d-952a-8cdc70f71a18","Type":"ContainerStarted","Data":"2d6f07cc2d5744a0e8649b4f4be897d9d749e707bd7da652b5334e34c175fc83"} Jun 06 19:03:11.516968 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:11.516935 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" event={"ID":"7e75363e-d603-4e5d-952a-8cdc70f71a18","Type":"ContainerStarted","Data":"28b54a03d2fe71ed394652f7188aa10af1f9f32161acc9da848c0fab7e3cf8a6"} Jun 06 19:03:11.531047 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:11.531001 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-895zv" podStartSLOduration=33.309075667 podStartE2EDuration="34.530985177s" totalImagesPullingTime="1.22190951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:11.530341631 +0000 UTC m=+270.319733415" watchObservedRunningTime="2026-06-06 19:03:11.530985177 +0000 UTC m=+270.320376961" Jun 06 19:03:11.620074 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:11.620038 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:11.718159 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:11.718129 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:11.905409 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:11.905334 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:12.060689 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.060657 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:12.079245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.079215 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9"] Jun 06 19:03:12.082576 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.082543 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:12.084895 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.084867 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 19:03:12.084984 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.084908 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cmq76\"" Jun 06 19:03:12.092629 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.092611 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9"] Jun 06 19:03:12.199931 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.199822 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rm6p9\" (UID: \"26e93b3a-fa29-4aa4-86f5-584436238a4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:12.301057 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.301013 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rm6p9\" (UID: \"26e93b3a-fa29-4aa4-86f5-584436238a4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:12.301235 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:12.301145 2548 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 06 19:03:12.301235 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:12.301201 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates podName:26e93b3a-fa29-4aa4-86f5-584436238a4a nodeName:}" failed. No retries permitted until 2026-06-06 19:03:12.80118698 +0000 UTC m=+271.590578742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-rm6p9" (UID: "26e93b3a-fa29-4aa4-86f5-584436238a4a") : secret "prometheus-operator-admission-webhook-tls" not found Jun 06 19:03:12.438401 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.438368 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:12.805178 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.805140 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rm6p9\" (UID: \"26e93b3a-fa29-4aa4-86f5-584436238a4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:12.807463 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.807443 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26e93b3a-fa29-4aa4-86f5-584436238a4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rm6p9\" (UID: \"26e93b3a-fa29-4aa4-86f5-584436238a4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:12.991780 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:12.991743 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:13.117104 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:13.116986 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9"] Jun 06 19:03:13.119678 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:13.119652 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e93b3a_fa29_4aa4_86f5_584436238a4a.slice/crio-95e35f2411ca5bcee56e55ed6b3579144f967497a081b4f71acd2a07c56f8700 WatchSource:0}: Error finding container 95e35f2411ca5bcee56e55ed6b3579144f967497a081b4f71acd2a07c56f8700: Status 404 returned error can't find the container with id 95e35f2411ca5bcee56e55ed6b3579144f967497a081b4f71acd2a07c56f8700 Jun 06 19:03:13.524531 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:13.524495 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" event={"ID":"26e93b3a-fa29-4aa4-86f5-584436238a4a","Type":"ContainerStarted","Data":"95e35f2411ca5bcee56e55ed6b3579144f967497a081b4f71acd2a07c56f8700"} Jun 06 19:03:14.528943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:14.528909 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" event={"ID":"26e93b3a-fa29-4aa4-86f5-584436238a4a","Type":"ContainerStarted","Data":"db2d55904b7fc9b7565e079c121504288c45d2b59139aa03991ab816cc281bca"} Jun 06 19:03:14.529381 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:14.529102 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:14.533656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:14.533635 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" Jun 06 19:03:14.558911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:14.558864 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rm6p9" podStartSLOduration=1.59929131 podStartE2EDuration="2.558849787s" totalImagesPullingTime="959.558477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:14.54349186 +0000 UTC m=+273.332883645" watchObservedRunningTime="2026-06-06 19:03:14.558849787 +0000 UTC m=+273.348241571" Jun 06 19:03:15.100228 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.100194 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:15.140962 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.140928 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2"] Jun 06 19:03:15.144513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.144495 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.147054 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.147034 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 19:03:15.148458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.148325 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 19:03:15.148458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.148338 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 19:03:15.148458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.148357 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 19:03:15.148458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.148358 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 19:03:15.148458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.148414 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wzntb\"" Jun 06 19:03:15.152465 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.152445 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2"] Jun 06 19:03:15.169739 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.169714 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:15.224927 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.224897 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.225051 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.224944 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.225051 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.224968 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ktl\" (UniqueName: \"kubernetes.io/projected/9bb1d88b-2394-4008-820b-37c91501a02c-kube-api-access-42ktl\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.225128 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.225050 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb1d88b-2394-4008-820b-37c91501a02c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.325647 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.325616 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb1d88b-2394-4008-820b-37c91501a02c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.325766 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.325686 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.325766 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.325720 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.325766 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.325743 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ktl\" (UniqueName: \"kubernetes.io/projected/9bb1d88b-2394-4008-820b-37c91501a02c-kube-api-access-42ktl\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.326469 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.326445 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb1d88b-2394-4008-820b-37c91501a02c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.328201 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.328183 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.328292 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.328246 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9bb1d88b-2394-4008-820b-37c91501a02c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.333219 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.333199 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ktl\" (UniqueName: \"kubernetes.io/projected/9bb1d88b-2394-4008-820b-37c91501a02c-kube-api-access-42ktl\") pod \"prometheus-operator-7f7d445d84-d9lm2\" (UID: \"9bb1d88b-2394-4008-820b-37c91501a02c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.360682 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.360631 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:15.454076 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.454037 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" Jun 06 19:03:15.576946 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:15.576913 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2"] Jun 06 19:03:15.579976 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:15.579949 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb1d88b_2394_4008_820b_37c91501a02c.slice/crio-eb29b3b9867baa8cde1bfd03d8a1c261a4fa39329f925bbea23ada3c69c34b8a WatchSource:0}: Error finding container eb29b3b9867baa8cde1bfd03d8a1c261a4fa39329f925bbea23ada3c69c34b8a: Status 404 returned error can't find the container with id eb29b3b9867baa8cde1bfd03d8a1c261a4fa39329f925bbea23ada3c69c34b8a Jun 06 19:03:16.536707 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:16.536656 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" event={"ID":"9bb1d88b-2394-4008-820b-37c91501a02c","Type":"ContainerStarted","Data":"eb29b3b9867baa8cde1bfd03d8a1c261a4fa39329f925bbea23ada3c69c34b8a"} Jun 06 19:03:17.350938 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:17.350862 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:17.545599 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:17.545545 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" event={"ID":"9bb1d88b-2394-4008-820b-37c91501a02c","Type":"ContainerStarted","Data":"eb8e8cac38d6c80ba6048913fd93723a42d26dd6e329542a9606086e0a855ab0"} Jun 06 19:03:17.545796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:17.545652 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" event={"ID":"9bb1d88b-2394-4008-820b-37c91501a02c","Type":"ContainerStarted","Data":"5a560cc074ecb8cc62d434a5efbf839a751f9eaab9bbb59349cfcef1818607f3"} Jun 06 19:03:17.561107 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:17.561056 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-d9lm2" podStartSLOduration=1.054091937 podStartE2EDuration="2.56104186s" totalImagesPullingTime="1.506949923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:17.560371781 +0000 UTC m=+276.349763566" watchObservedRunningTime="2026-06-06 19:03:17.56104186 +0000 UTC m=+276.350433644" Jun 06 19:03:19.230593 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.230545 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.400140 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.400109 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.478664 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.478609 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.485948 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.485871 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk"] Jun 06 19:03:19.489680 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.489656 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t5gqs"] Jun 06 19:03:19.489855 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.489780 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.492159 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.492137 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 06 19:03:19.492307 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.492217 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tvvpz\"" Jun 06 19:03:19.492421 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.492242 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 06 19:03:19.493076 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.493059 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.493289 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.493273 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 06 19:03:19.495216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.495197 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4tk75\"" Jun 06 19:03:19.495476 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.495461 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 19:03:19.496009 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.495990 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 19:03:19.496212 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.496195 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 19:03:19.501016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.500993 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk"] Jun 06 19:03:19.553625 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.553594 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.559134 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559111 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559264 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559157 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559264 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559187 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gswb5\" (UniqueName: \"kubernetes.io/projected/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-api-access-gswb5\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559264 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559204 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-metrics-client-ca\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559264 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559249 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klrtl\" (UniqueName: \"kubernetes.io/projected/d27c5c12-280e-4667-8f14-a4c2a4c08536-kube-api-access-klrtl\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559285 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-root\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559312 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559340 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/20ee0f30-8b42-4d22-ac81-a3b8532b128b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559368 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559399 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-textfile\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559441 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559776 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559475 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-wtmp\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559776 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559523 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-sys\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.559776 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559552 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.559776 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.559619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.653775 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.653743 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.660414 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660377 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gswb5\" (UniqueName: \"kubernetes.io/projected/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-api-access-gswb5\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.660513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-metrics-client-ca\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.660513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660461 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klrtl\" (UniqueName: \"kubernetes.io/projected/d27c5c12-280e-4667-8f14-a4c2a4c08536-kube-api-access-klrtl\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.660513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660486 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-root\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.660513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660509 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.660723 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660535 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/20ee0f30-8b42-4d22-ac81-a3b8532b128b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.660723 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660619 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.660723 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-textfile\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.660860 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660757 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.660911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.660867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-wtmp\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.661025 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661001 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-textfile\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.661078 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661021 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/20ee0f30-8b42-4d22-ac81-a3b8532b128b-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.661131 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661073 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-root\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661209 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-wtmp\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661250 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-sys\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661292 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661343 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661370 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27c5c12-280e-4667-8f14-a4c2a4c08536-sys\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661405 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661456 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661461 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.661476 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-metrics-client-ca\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:19.661678 2548 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:19.662059 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls podName:d27c5c12-280e-4667-8f14-a4c2a4c08536 nodeName:}" failed. No retries permitted until 2026-06-06 19:03:20.161725527 +0000 UTC m=+278.951117297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls") pod "node-exporter-t5gqs" (UID: "d27c5c12-280e-4667-8f14-a4c2a4c08536") : secret "node-exporter-tls" not found Jun 06 19:03:19.662130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.662093 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.662808 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.662188 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.663684 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.663607 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.663935 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.663915 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.664524 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.664491 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.671742 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.671652 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gswb5\" (UniqueName: \"kubernetes.io/projected/20ee0f30-8b42-4d22-ac81-a3b8532b128b-kube-api-access-gswb5\") pod \"kube-state-metrics-57bbf8bfb5-gjgqk\" (UID: \"20ee0f30-8b42-4d22-ac81-a3b8532b128b\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.672618 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.672547 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klrtl\" (UniqueName: \"kubernetes.io/projected/d27c5c12-280e-4667-8f14-a4c2a4c08536-kube-api-access-klrtl\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:19.754655 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.754573 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.802458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.802428 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" Jun 06 19:03:19.856416 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.856384 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:19.945175 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.945154 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk"] Jun 06 19:03:19.947638 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:19.947602 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ee0f30_8b42_4d22_ac81_a3b8532b128b.slice/crio-d05f863c5e4e84f80d4335849846674360a41bcbf8e21a62c1a6454c0bff79fd WatchSource:0}: Error finding container d05f863c5e4e84f80d4335849846674360a41bcbf8e21a62c1a6454c0bff79fd: Status 404 returned error can't find the container with id d05f863c5e4e84f80d4335849846674360a41bcbf8e21a62c1a6454c0bff79fd Jun 06 19:03:19.947887 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:19.947862 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:20.019879 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.019816 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:20.166850 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.166811 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:20.169047 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.169030 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27c5c12-280e-4667-8f14-a4c2a4c08536-node-exporter-tls\") pod \"node-exporter-t5gqs\" (UID: \"d27c5c12-280e-4667-8f14-a4c2a4c08536\") " pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:20.407854 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.407769 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5gqs" Jun 06 19:03:20.420897 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:20.420868 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27c5c12_280e_4667_8f14_a4c2a4c08536.slice/crio-e3ece0737130e6ceb334cfc8acce99f10beee0930821ead7f0d91a201376408f WatchSource:0}: Error finding container e3ece0737130e6ceb334cfc8acce99f10beee0930821ead7f0d91a201376408f: Status 404 returned error can't find the container with id e3ece0737130e6ceb334cfc8acce99f10beee0930821ead7f0d91a201376408f Jun 06 19:03:20.464249 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.464218 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:20.541842 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.541802 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:20.558262 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.558216 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" event={"ID":"20ee0f30-8b42-4d22-ac81-a3b8532b128b","Type":"ContainerStarted","Data":"d05f863c5e4e84f80d4335849846674360a41bcbf8e21a62c1a6454c0bff79fd"} Jun 06 19:03:20.559757 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.559733 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5gqs" event={"ID":"d27c5c12-280e-4667-8f14-a4c2a4c08536","Type":"ContainerStarted","Data":"e3ece0737130e6ceb334cfc8acce99f10beee0930821ead7f0d91a201376408f"} Jun 06 19:03:20.769360 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:20.769325 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:21.396196 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.396142 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:21.400661 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.400639 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.403244 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.403193 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 19:03:21.403244 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.403214 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 19:03:21.403450 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.403218 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v9j82\"" Jun 06 19:03:21.404374 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.404347 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 19:03:21.404470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.404393 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 19:03:21.404470 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.404462 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 19:03:21.404678 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.404653 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 19:03:21.404784 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.404655 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 19:03:21.410637 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.410604 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:21.410943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.410852 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 19:03:21.481524 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481544 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481635 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481683 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481870 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481717 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.481870 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.481760 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpqqw\" (UniqueName: \"kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.568729 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.568698 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" event={"ID":"20ee0f30-8b42-4d22-ac81-a3b8532b128b","Type":"ContainerStarted","Data":"bb2d5f2caa74b286aa860b1251486e3e2a09c0bd499e32403a6734f0c7057f0c"} Jun 06 19:03:21.571019 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.570990 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5gqs" event={"ID":"d27c5c12-280e-4667-8f14-a4c2a4c08536","Type":"ContainerStarted","Data":"06cd0fb496c074a3a812ce2e9c72c00a04e6a7a24e483afd8e4e622e93cd4d7f"} Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583226 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583270 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpqqw\" (UniqueName: \"kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583343 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583394 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583427 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583457 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.583656 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.583485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.584274 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.584249 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.584689 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.584655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.584768 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.584724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.584918 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.584894 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.587236 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.587212 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.587958 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.587938 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.597088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.597059 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpqqw\" (UniqueName: \"kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw\") pod \"console-548fc9d48d-t6rjf\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.711923 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.711876 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:21.850309 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:21.850283 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:22.431467 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.431425 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:22.468892 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.468857 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx"] Jun 06 19:03:22.473541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.473515 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.476167 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.476143 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 19:03:22.476491 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.476469 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 19:03:22.478391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.476679 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 19:03:22.478391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.476897 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 19:03:22.478391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.477066 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 19:03:22.478391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.477339 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fa5359u5jsr0p\"" Jun 06 19:03:22.478391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.477535 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8bkrf\"" Jun 06 19:03:22.482782 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.482749 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx"] Jun 06 19:03:22.497849 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.497815 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:22.577430 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.577390 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc9d48d-t6rjf" event={"ID":"3ea37170-8e57-4cc9-acb2-52af39c29522","Type":"ContainerStarted","Data":"ee6bf719aef525077390b36e15cf21003da7801a62cfb90c3cc3787c2ad21e74"} Jun 06 19:03:22.580015 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.579982 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" event={"ID":"20ee0f30-8b42-4d22-ac81-a3b8532b128b","Type":"ContainerStarted","Data":"874d595d553ff18bb1b13471ba969cd00f3a05d075c7675bf8334e7680763583"} Jun 06 19:03:22.580181 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.580040 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" event={"ID":"20ee0f30-8b42-4d22-ac81-a3b8532b128b","Type":"ContainerStarted","Data":"5a263f8ba132c8028b2a03a9a15a348778f5b12e0d9b944c4ef09d935a7a99ea"} Jun 06 19:03:22.582074 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.582044 2548 generic.go:356] "Generic (PLEG): container finished" podID="d27c5c12-280e-4667-8f14-a4c2a4c08536" containerID="06cd0fb496c074a3a812ce2e9c72c00a04e6a7a24e483afd8e4e622e93cd4d7f" exitCode=0 Jun 06 19:03:22.582193 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.582094 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5gqs" event={"ID":"d27c5c12-280e-4667-8f14-a4c2a4c08536","Type":"ContainerDied","Data":"06cd0fb496c074a3a812ce2e9c72c00a04e6a7a24e483afd8e4e622e93cd4d7f"} Jun 06 19:03:22.592252 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592222 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592265 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-grpc-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592305 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592331 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06d5779-9d49-41d0-99e4-9579fe16cf59-metrics-client-ca\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592360 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592637 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592404 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592637 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592454 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfgd\" (UniqueName: \"kubernetes.io/projected/f06d5779-9d49-41d0-99e4-9579fe16cf59-kube-api-access-fsfgd\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.592637 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.592530 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.598668 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.598601 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gjgqk" podStartSLOduration=2.056582738 podStartE2EDuration="3.598586016s" totalImagesPullingTime="1.542003278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:22.597186812 +0000 UTC m=+281.386578600" watchObservedRunningTime="2026-06-06 19:03:22.598586016 +0000 UTC m=+281.387977801" Jun 06 19:03:22.643229 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.643198 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:22.693939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.693872 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.693939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.693914 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-grpc-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.693971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.693998 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06d5779-9d49-41d0-99e4-9579fe16cf59-metrics-client-ca\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.694042 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.694107 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694320 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.694189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfgd\" (UniqueName: \"kubernetes.io/projected/f06d5779-9d49-41d0-99e4-9579fe16cf59-kube-api-access-fsfgd\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.694320 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.694279 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.695772 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.695712 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f06d5779-9d49-41d0-99e4-9579fe16cf59-metrics-client-ca\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.697429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.697405 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.697891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.697867 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-grpc-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.697965 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.697941 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-tls\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.698092 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.698066 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.698803 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.698699 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.700097 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.700073 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f06d5779-9d49-41d0-99e4-9579fe16cf59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.702647 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.702616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfgd\" (UniqueName: \"kubernetes.io/projected/f06d5779-9d49-41d0-99e4-9579fe16cf59-kube-api-access-fsfgd\") pod \"thanos-querier-6bd8cf475b-xjbtx\" (UID: \"f06d5779-9d49-41d0-99e4-9579fe16cf59\") " pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.788400 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.788360 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:22.968010 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:22.967905 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx"] Jun 06 19:03:22.970306 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:22.970269 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06d5779_9d49_41d0_99e4_9579fe16cf59.slice/crio-cf015771eaef8de215c3975cbd3c6b8974a83fcc9a049b7824b34c5a2ddd4412 WatchSource:0}: Error finding container cf015771eaef8de215c3975cbd3c6b8974a83fcc9a049b7824b34c5a2ddd4412: Status 404 returned error can't find the container with id cf015771eaef8de215c3975cbd3c6b8974a83fcc9a049b7824b34c5a2ddd4412 Jun 06 19:03:23.193007 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:23.192961 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" Jun 06 19:03:23.193160 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:23.192972 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ktxws" podUID="52bf4dee-5e9a-4856-8755-988585d65388" Jun 06 19:03:23.246587 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.246537 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:23.588371 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.588280 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"cf015771eaef8de215c3975cbd3c6b8974a83fcc9a049b7824b34c5a2ddd4412"} Jun 06 19:03:23.590801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.590773 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5gqs" event={"ID":"d27c5c12-280e-4667-8f14-a4c2a4c08536","Type":"ContainerStarted","Data":"7088aacb2e88ea2023c87549b370b332f9e30bc16317e7da78d99aa8dcf1d219"} Jun 06 19:03:23.590935 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.590827 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5gqs" event={"ID":"d27c5c12-280e-4667-8f14-a4c2a4c08536","Type":"ContainerStarted","Data":"f4c3d67e979c322a112407d31362c4a5b23f217159a7d50d2ef6ad86e681141d"} Jun 06 19:03:23.591230 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.591211 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:23.591654 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:23.591366 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:24.104575 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:24.104523 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:24.160214 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:24.160176 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:24.276640 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:24.276547 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:24.329325 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:24.329263 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:24.841810 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:24.841777 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:25.603462 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.603393 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"af10d4f006252012d08f101e10e531c5da8f9b114508ff6dc0fa199cfdbeb0b8"} Jun 06 19:03:25.603462 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.603422 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:25.603754 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.603485 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"cc0c7cbaa9d8a3a4e4f2226b26fda11d589799bddfc617f13bb4e9997edf718e"} Jun 06 19:03:25.603754 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.603541 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"5d5398541d967ddc6acb520b24527c8de592fbade3af79a8af25cc38ce61c838"} Jun 06 19:03:25.605270 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.605242 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc9d48d-t6rjf" event={"ID":"3ea37170-8e57-4cc9-acb2-52af39c29522","Type":"ContainerStarted","Data":"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498"} Jun 06 19:03:25.623157 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.623116 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t5gqs" podStartSLOduration=5.473231679 podStartE2EDuration="6.623101513s" totalImagesPullingTime="1.071440363s" totalInitContainerRuntime="78.429471ms" isStatefulPod=true podCreationTimestamp="2026-06-06 19:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:23.608247166 +0000 UTC m=+282.397638950" watchObservedRunningTime="2026-06-06 19:03:25.623101513 +0000 UTC m=+284.412493328" Jun 06 19:03:25.623453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.623427 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548fc9d48d-t6rjf" podStartSLOduration=1.259654911 podStartE2EDuration="4.623419089s" totalImagesPullingTime="3.363764178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:25.621764475 +0000 UTC m=+284.411156260" watchObservedRunningTime="2026-06-06 19:03:25.623419089 +0000 UTC m=+284.412810873" Jun 06 19:03:25.678998 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.678957 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:03:25.683361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.683330 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.684741 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.684687 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.685889 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686139 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686389 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686637 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686709 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686718 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686966 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 19:03:25.687130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.686970 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 19:03:25.687667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687144 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 19:03:25.687667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687162 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 19:03:25.687667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687170 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 19:03:25.687667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687424 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 19:03:25.687667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687440 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 19:03:25.688016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687729 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 19:03:25.688016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687754 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-docjll7nig5g2\"" Jun 06 19:03:25.688016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.687922 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b5fd6\"" Jun 06 19:03:25.689830 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.689810 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 19:03:25.701047 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.701025 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:03:25.825062 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825023 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdld\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825062 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825061 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825113 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825133 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825151 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825198 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825215 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825229 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825287 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825315 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825342 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825407 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825444 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825500 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825522 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825580 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825610 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825623 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825654 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.825796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.825681 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926396 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926317 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926396 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926357 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926396 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926382 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926593 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926640 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926670 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926697 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926721 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926744 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926797 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926824 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926891 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.926954 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926931 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.926993 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927038 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927078 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927105 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdld\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927133 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.927453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.927148 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.928052 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.928019 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.928190 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.928165 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.928980 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.928955 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.929690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.929657 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.929690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.929675 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.929933 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.929910 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.930008 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.929964 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.930008 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.929981 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.930698 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.930546 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.931690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.930789 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.931690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.930895 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.931690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.931391 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.932287 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.932265 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.932861 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.932812 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.932987 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.932963 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.933212 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.933153 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.933424 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.933398 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.938525 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.938505 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdld\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld\") pod \"prometheus-k8s-0\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:25.994978 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:25.994709 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:26.163202 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.163177 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:03:26.232866 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:26.232825 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6808f8_2dd0_455f_9a8d_02220c591c3f.slice/crio-98d8a4fcf62b56d72593c3bd2a407557ab5275296a9b832cfd2060993f587840 WatchSource:0}: Error finding container 98d8a4fcf62b56d72593c3bd2a407557ab5275296a9b832cfd2060993f587840: Status 404 returned error can't find the container with id 98d8a4fcf62b56d72593c3bd2a407557ab5275296a9b832cfd2060993f587840 Jun 06 19:03:26.613075 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.612984 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"2de0ef5542c38a63308e711b337cf6a7a3a471da20993cf6959a9bc7dd37ba00"} Jun 06 19:03:26.613075 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.613066 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"64bd9c6e3c5fe613377f262bc3dd497bcd0acf6f03d68a25cdd080002769763a"} Jun 06 19:03:26.613283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.613110 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" event={"ID":"f06d5779-9d49-41d0-99e4-9579fe16cf59","Type":"ContainerStarted","Data":"83b306c5892389c324f561280e7e220389b612afbb1cdab4a9b805a0da0b9980"} Jun 06 19:03:26.613283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.613259 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:26.614670 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.614646 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"98d8a4fcf62b56d72593c3bd2a407557ab5275296a9b832cfd2060993f587840"} Jun 06 19:03:26.635601 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.635531 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" podStartSLOduration=1.525974782 podStartE2EDuration="4.635512677s" totalImagesPullingTime="3.109537895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:26.633641651 +0000 UTC m=+285.423033448" watchObservedRunningTime="2026-06-06 19:03:26.635512677 +0000 UTC m=+285.424904463" Jun 06 19:03:26.938467 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.938374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:26.938891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.938540 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:26.941002 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.940973 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bf4dee-5e9a-4856-8755-988585d65388-metrics-tls\") pod \"dns-default-ktxws\" (UID: \"52bf4dee-5e9a-4856-8755-988585d65388\") " pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:26.941138 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:26.941105 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"image-registry-b785f5b75-zsrpm\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:27.194828 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.194774 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rt55d\"" Jun 06 19:03:27.194828 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.194780 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqxk9\"" Jun 06 19:03:27.201808 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.201777 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:27.201908 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.201858 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:27.351534 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.351501 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ktxws"] Jun 06 19:03:27.354652 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:27.354623 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bf4dee_5e9a_4856_8755_988585d65388.slice/crio-62a9c8a17000eb47e9749903919e48e6693a437b7d7def9ef734dbb6436f7e62 WatchSource:0}: Error finding container 62a9c8a17000eb47e9749903919e48e6693a437b7d7def9ef734dbb6436f7e62: Status 404 returned error can't find the container with id 62a9c8a17000eb47e9749903919e48e6693a437b7d7def9ef734dbb6436f7e62 Jun 06 19:03:27.374625 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.374545 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 19:03:27.376667 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:03:27.376642 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f10034_e153_4d1b_ad85_406a45c30a60.slice/crio-330cefd600b0c21a6de013d05a7062e077b8805d5bfe6316191bcfa9948661f3 WatchSource:0}: Error finding container 330cefd600b0c21a6de013d05a7062e077b8805d5bfe6316191bcfa9948661f3: Status 404 returned error can't find the container with id 330cefd600b0c21a6de013d05a7062e077b8805d5bfe6316191bcfa9948661f3 Jun 06 19:03:27.620696 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.620664 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" exitCode=0 Jun 06 19:03:27.620847 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.620753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} Jun 06 19:03:27.622467 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.622417 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" event={"ID":"30f10034-e153-4d1b-ad85-406a45c30a60","Type":"ContainerStarted","Data":"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b"} Jun 06 19:03:27.622467 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.622454 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" event={"ID":"30f10034-e153-4d1b-ad85-406a45c30a60","Type":"ContainerStarted","Data":"330cefd600b0c21a6de013d05a7062e077b8805d5bfe6316191bcfa9948661f3"} Jun 06 19:03:27.622606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.622480 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:27.623650 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.623627 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktxws" event={"ID":"52bf4dee-5e9a-4856-8755-988585d65388","Type":"ContainerStarted","Data":"62a9c8a17000eb47e9749903919e48e6693a437b7d7def9ef734dbb6436f7e62"} Jun 06 19:03:27.668079 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:27.668027 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" podStartSLOduration=285.668010807 podStartE2EDuration="4m45.668010807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:27.667336412 +0000 UTC m=+286.456728197" watchObservedRunningTime="2026-06-06 19:03:27.668010807 +0000 UTC m=+286.457402591" Jun 06 19:03:29.634823 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:29.634782 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktxws" event={"ID":"52bf4dee-5e9a-4856-8755-988585d65388","Type":"ContainerStarted","Data":"a875aa99303d0138ecd5383de9b2790a229d38a820730622c3049b2404d636be"} Jun 06 19:03:29.635273 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:29.634889 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ktxws" event={"ID":"52bf4dee-5e9a-4856-8755-988585d65388","Type":"ContainerStarted","Data":"289709cfba7de6112003d3fd5cb5cdfa08d173677686a5e81af9870b1c10cc45"} Jun 06 19:03:29.635273 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:29.634924 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:29.651974 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:29.651910 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ktxws" podStartSLOduration=250.926821301 podStartE2EDuration="4m12.651895087s" totalImagesPullingTime="1.725073786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:29.650758269 +0000 UTC m=+288.440150088" watchObservedRunningTime="2026-06-06 19:03:29.651895087 +0000 UTC m=+288.441286873" Jun 06 19:03:30.000388 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:30.000315 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:30.047344 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:30.047307 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:30.287419 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:30.287334 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:31.653012 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.652977 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} Jun 06 19:03:31.653429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.653059 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} Jun 06 19:03:31.653429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.653091 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} Jun 06 19:03:31.653429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.653116 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} Jun 06 19:03:31.653429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.653139 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} Jun 06 19:03:31.653429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.653166 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerStarted","Data":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} Jun 06 19:03:31.681773 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.681717 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.671919538 podStartE2EDuration="6.68170228s" totalImagesPullingTime="3.993111716s" totalInitContainerRuntime="16.671026ms" isStatefulPod=false podCreationTimestamp="2026-06-06 19:03:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:03:31.678920935 +0000 UTC m=+290.468312721" watchObservedRunningTime="2026-06-06 19:03:31.68170228 +0000 UTC m=+290.471094073" Jun 06 19:03:31.713429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:31.713399 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:32.630287 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:32.630261 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bd8cf475b-xjbtx" Jun 06 19:03:35.044191 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:35.044139 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:35.995442 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:35.995404 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:03:39.644357 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:39.644324 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ktxws" Jun 06 19:03:39.710145 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:39.710105 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8dmrz" podUID="7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0" Jun 06 19:03:41.682824 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:41.682797 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:03:41.685389 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:41.685368 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:03:41.685595 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:41.685551 2548 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 19:03:43.617530 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:43.617499 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:44.678022 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:44.677989 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:47.206265 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:47.206224 2548 patch_prober.go:28] interesting pod/image-registry-b785f5b75-zsrpm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 19:03:47.206678 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:47.206283 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 19:03:48.101016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.100980 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.202481 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.202446 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.633018 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.632988 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:03:48.721374 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.721337 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.823827 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.823795 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.875804 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.875764 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.928465 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.928391 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:48.982253 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:48.982225 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:50.801078 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:50.801045 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:50.991144 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:50.991113 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:51.091014 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:51.090935 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:51.733806 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:51.733777 2548 generic.go:356] "Generic (PLEG): container finished" podID="03214659-182f-4a11-a9bf-3b0d42462df5" containerID="70ea5b3e9b208aba5ac5662e06a3951249115bc5ef4a0f2315697bee11fdf668" exitCode=0 Jun 06 19:03:51.733966 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:51.733848 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" event={"ID":"03214659-182f-4a11-a9bf-3b0d42462df5","Type":"ContainerDied","Data":"70ea5b3e9b208aba5ac5662e06a3951249115bc5ef4a0f2315697bee11fdf668"} Jun 06 19:03:51.734200 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:51.734184 2548 scope.go:117] "RemoveContainer" containerID="70ea5b3e9b208aba5ac5662e06a3951249115bc5ef4a0f2315697bee11fdf668" Jun 06 19:03:52.739381 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:52.739350 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-2qjr6" event={"ID":"03214659-182f-4a11-a9bf-3b0d42462df5","Type":"ContainerStarted","Data":"eb39b6129155b349f7c35f9b31f31d64374a240ceea3fe216beda32b07ca9b2c"} Jun 06 19:03:54.408209 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:54.408175 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 19:03:54.476047 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:54.476019 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:54.577002 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:54.576971 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:54.709357 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:54.709284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:03:55.310885 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.310824 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-548fc9d48d-t6rjf" podUID="3ea37170-8e57-4cc9-acb2-52af39c29522" containerName="console" containerID="cri-o://ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498" gracePeriod=15 Jun 06 19:03:55.582827 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.582775 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:55.706619 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706587 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706749 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706631 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706749 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706657 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706749 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706699 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706749 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706722 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706759 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpqqw\" (UniqueName: \"kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.706943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706818 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config\") pod \"3ea37170-8e57-4cc9-acb2-52af39c29522\" (UID: \"3ea37170-8e57-4cc9-acb2-52af39c29522\") " Jun 06 19:03:55.707045 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.706954 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config" (OuterVolumeSpecName: "console-config") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:03:55.707207 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.707151 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:03:55.707207 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.707156 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:03:55.707207 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.707170 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-console-config\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.707207 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.707166 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:03:55.708921 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.708890 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:03:55.709030 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.708976 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:03:55.709091 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.709028 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw" (OuterVolumeSpecName: "kube-api-access-xpqqw") pod "3ea37170-8e57-4cc9-acb2-52af39c29522" (UID: "3ea37170-8e57-4cc9-acb2-52af39c29522"). InnerVolumeSpecName "kube-api-access-xpqqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:03:55.753433 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.753405 2548 generic.go:356] "Generic (PLEG): container finished" podID="3ea37170-8e57-4cc9-acb2-52af39c29522" containerID="ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498" exitCode=0 Jun 06 19:03:55.753533 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.753445 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548fc9d48d-t6rjf" Jun 06 19:03:55.753533 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.753501 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc9d48d-t6rjf" event={"ID":"3ea37170-8e57-4cc9-acb2-52af39c29522","Type":"ContainerDied","Data":"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498"} Jun 06 19:03:55.753675 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.753551 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548fc9d48d-t6rjf" event={"ID":"3ea37170-8e57-4cc9-acb2-52af39c29522","Type":"ContainerDied","Data":"ee6bf719aef525077390b36e15cf21003da7801a62cfb90c3cc3787c2ad21e74"} Jun 06 19:03:55.753675 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.753598 2548 scope.go:117] "RemoveContainer" containerID="ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498" Jun 06 19:03:55.761939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.761919 2548 scope.go:117] "RemoveContainer" containerID="ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498" Jun 06 19:03:55.762207 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:03:55.762178 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498\": container with ID starting with ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498 not found: ID does not exist" containerID="ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498" Jun 06 19:03:55.762255 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.762216 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498"} err="failed to get container status \"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498\": rpc error: code = NotFound desc = could not find container \"ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498\": container with ID starting with ba1788c5cad59f10cac88e8be60457b78a07948d618aa4debdc0068dd278d498 not found: ID does not exist" Jun 06 19:03:55.769490 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.769468 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:55.772855 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.772836 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548fc9d48d-t6rjf"] Jun 06 19:03:55.807994 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.807971 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpqqw\" (UniqueName: \"kubernetes.io/projected/3ea37170-8e57-4cc9-acb2-52af39c29522-kube-api-access-xpqqw\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.807994 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.807989 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-oauth-config\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.808139 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.807999 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea37170-8e57-4cc9-acb2-52af39c29522-console-serving-cert\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.808139 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.808007 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-trusted-ca-bundle\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.808139 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.808017 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-oauth-serving-cert\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:55.808139 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:55.808026 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea37170-8e57-4cc9-acb2-52af39c29522-service-ca\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:03:56.760324 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:56.760242 2548 generic.go:356] "Generic (PLEG): container finished" podID="98b9da27-7a6d-4d56-a7d4-21eb40853ec1" containerID="e0996e50daafe79fb09194bf0b2ae114256af4b19357151f2b245470e4dc0d70" exitCode=0 Jun 06 19:03:56.760324 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:56.760293 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" event={"ID":"98b9da27-7a6d-4d56-a7d4-21eb40853ec1","Type":"ContainerDied","Data":"e0996e50daafe79fb09194bf0b2ae114256af4b19357151f2b245470e4dc0d70"} Jun 06 19:03:56.760797 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:56.760619 2548 scope.go:117] "RemoveContainer" containerID="e0996e50daafe79fb09194bf0b2ae114256af4b19357151f2b245470e4dc0d70" Jun 06 19:03:57.714479 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:57.714446 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea37170-8e57-4cc9-acb2-52af39c29522" path="/var/lib/kubelet/pods/3ea37170-8e57-4cc9-acb2-52af39c29522/volumes" Jun 06 19:03:57.766981 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:57.766950 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9r6dg" event={"ID":"98b9da27-7a6d-4d56-a7d4-21eb40853ec1","Type":"ContainerStarted","Data":"040b2251e7a5d7d235520a608a1888228f2f7f9fc9c450f6a6690fe98afc9f3f"} Jun 06 19:03:57.770364 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:57.770337 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:57.871742 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:57.871717 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:58.959965 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:58.959935 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:03:59.009547 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:03:59.009518 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:00.945977 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:00.945944 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:06.802460 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:06.802420 2548 generic.go:356] "Generic (PLEG): container finished" podID="cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6" containerID="8077458f0bf9029eb98aef5a69753fe9d13b70bf27259a875aabbf8ece91cdc9" exitCode=0 Jun 06 19:04:06.802892 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:06.802491 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nbblc" event={"ID":"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6","Type":"ContainerDied","Data":"8077458f0bf9029eb98aef5a69753fe9d13b70bf27259a875aabbf8ece91cdc9"} Jun 06 19:04:06.802892 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:06.802861 2548 scope.go:117] "RemoveContainer" containerID="8077458f0bf9029eb98aef5a69753fe9d13b70bf27259a875aabbf8ece91cdc9" Jun 06 19:04:07.326496 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:07.326470 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgjl7_c9a88ecd-f049-4ee9-97e4-3bd47283aa52/serve-healthcheck-canary/0.log" Jun 06 19:04:07.727722 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:07.727695 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-4r5tl_d540a8b2-944f-4d99-9672-8edc462e4d11/cluster-samples-operator/0.log" Jun 06 19:04:07.808084 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:07.808051 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nbblc" event={"ID":"cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6","Type":"ContainerStarted","Data":"6790e81516607bee10790123166c48453f1f5570ed783a8dce2fd1e038e6443c"} Jun 06 19:04:07.926510 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:07.926481 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-4r5tl_d540a8b2-944f-4d99-9672-8edc462e4d11/cluster-samples-operator-watch/0.log" Jun 06 19:04:08.066627 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:08.066538 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:08.166885 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:08.166840 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:08.878431 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:08.878400 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:11.592631 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:11.592591 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:11.693625 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:11.693591 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:13.618164 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:13.618130 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:13.665179 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:13.665154 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:19.428893 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:19.428826 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" containerName="registry" containerID="cri-o://22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b" gracePeriod=30 Jun 06 19:04:20.740383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.740355 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:04:20.835857 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835776 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.835857 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835815 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.835857 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835841 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.836135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835871 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.836135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835909 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.836135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.835968 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.836135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.836004 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.836291 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.836178 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:20.836291 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.836271 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-trusted-ca\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.836494 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.836460 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:20.838319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.838290 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:04:20.838569 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.838521 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:20.838844 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.838801 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:20.838950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.838887 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:04:20.846631 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.846608 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 19:04:20.866088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.865285 2548 generic.go:356] "Generic (PLEG): container finished" podID="30f10034-e153-4d1b-ad85-406a45c30a60" containerID="22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b" exitCode=0 Jun 06 19:04:20.866088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.865372 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" event={"ID":"30f10034-e153-4d1b-ad85-406a45c30a60","Type":"ContainerDied","Data":"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b"} Jun 06 19:04:20.866088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.865459 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" event={"ID":"30f10034-e153-4d1b-ad85-406a45c30a60","Type":"ContainerDied","Data":"330cefd600b0c21a6de013d05a7062e077b8805d5bfe6316191bcfa9948661f3"} Jun 06 19:04:20.866088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.865489 2548 scope.go:117] "RemoveContainer" containerID="22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b" Jun 06 19:04:20.866088 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.865700 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b785f5b75-zsrpm" Jun 06 19:04:20.885814 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.885790 2548 scope.go:117] "RemoveContainer" containerID="22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b" Jun 06 19:04:20.886121 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:20.886089 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b\": container with ID starting with 22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b not found: ID does not exist" containerID="22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b" Jun 06 19:04:20.886201 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.886122 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b"} err="failed to get container status \"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b\": rpc error: code = NotFound desc = could not find container \"22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b\": container with ID starting with 22e42534462d7e15ad5ccf4305881a78b1a58aea34ed019962fd9fd95b29a44b not found: ID does not exist" Jun 06 19:04:20.936828 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.936795 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhhmw\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw\") pod \"30f10034-e153-4d1b-ad85-406a45c30a60\" (UID: \"30f10034-e153-4d1b-ad85-406a45c30a60\") " Jun 06 19:04:20.937141 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937119 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-bound-sa-token\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.937216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937147 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30f10034-e153-4d1b-ad85-406a45c30a60-ca-trust-extracted\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.937216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937164 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-image-registry-private-configuration\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.937216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937179 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-registry-tls\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.937216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937191 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30f10034-e153-4d1b-ad85-406a45c30a60-registry-certificates\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.937216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.937205 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30f10034-e153-4d1b-ad85-406a45c30a60-installation-pull-secrets\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:20.939065 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:20.939041 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw" (OuterVolumeSpecName: "kube-api-access-vhhmw") pod "30f10034-e153-4d1b-ad85-406a45c30a60" (UID: "30f10034-e153-4d1b-ad85-406a45c30a60"). InnerVolumeSpecName "kube-api-access-vhhmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:04:21.038226 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:21.038191 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhhmw\" (UniqueName: \"kubernetes.io/projected/30f10034-e153-4d1b-ad85-406a45c30a60-kube-api-access-vhhmw\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:21.187959 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:21.187926 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 19:04:21.191217 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:21.191190 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b785f5b75-zsrpm"] Jun 06 19:04:21.714980 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:21.714944 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" path="/var/lib/kubelet/pods/30f10034-e153-4d1b-ad85-406a45c30a60/volumes" Jun 06 19:04:25.996180 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:25.996149 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:26.016126 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:26.016099 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:26.905451 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:26.905422 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:28.624219 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:28.624182 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:28.680280 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:28.680250 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:30.418573 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:30.418477 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:30.520012 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:30.519978 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:30.570455 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:30.570426 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:32.596794 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:32.596763 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:32.643274 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:32.643233 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:35.561731 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:35.561697 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:35.614969 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:35.614940 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:44.060858 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.060816 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:44.061367 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061178 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="prometheus" containerID="cri-o://cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" gracePeriod=600 Jun 06 19:04:44.061798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061499 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-web" containerID="cri-o://ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" gracePeriod=600 Jun 06 19:04:44.061798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061521 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy" containerID="cri-o://5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" gracePeriod=600 Jun 06 19:04:44.061798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061597 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="config-reloader" containerID="cri-o://3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" gracePeriod=600 Jun 06 19:04:44.061798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061712 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="thanos-sidecar" containerID="cri-o://f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" gracePeriod=600 Jun 06 19:04:44.061798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.061731 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" gracePeriod=600 Jun 06 19:04:44.315201 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.315141 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:44.439469 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439437 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439469 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439473 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439504 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439521 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439545 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439579 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439603 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439623 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439651 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439687 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439707 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.439730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439728 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439759 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzdld\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439775 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439796 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439813 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439840 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439857 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439874 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439890 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.439964 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs\") pod \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\" (UID: \"8f6808f8-2dd0-455f-9a8d-02220c591c3f\") " Jun 06 19:04:44.440238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440237 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.440755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440246 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.440755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440256 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-metrics-client-ca\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.440755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440300 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.440755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440488 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.440755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440723 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.441018 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.440907 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 19:04:44.441873 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.441480 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 19:04:44.442939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.442647 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.443141 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.443118 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:04:44.443215 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.443187 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.444016 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.443987 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out" (OuterVolumeSpecName: "config-out") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 19:04:44.444232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.444207 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.444304 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.444251 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.444646 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.444613 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.444804 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.444780 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.444939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.444910 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.445027 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.445005 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld" (OuterVolumeSpecName: "kube-api-access-nzdld") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "kube-api-access-nzdld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:04:44.445115 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.445097 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config" (OuterVolumeSpecName: "config") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.454493 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.454471 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config" (OuterVolumeSpecName: "web-config") pod "8f6808f8-2dd0-455f-9a8d-02220c591c3f" (UID: "8f6808f8-2dd0-455f-9a8d-02220c591c3f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 19:04:44.541282 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541254 2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541282 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541279 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541290 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541300 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541309 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-tls-assets\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541319 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-web-config\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541327 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config-out\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541334 2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-kube-rbac-proxy\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541344 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541354 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541362 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzdld\" (UniqueName: \"kubernetes.io/projected/8f6808f8-2dd0-455f-9a8d-02220c591c3f-kube-api-access-nzdld\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541370 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-db\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541380 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541387 2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-grpc-tls\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541395 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541403 2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-config\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541411 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541419 2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f6808f8-2dd0-455f-9a8d-02220c591c3f-secret-metrics-client-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.541459 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.541427 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f6808f8-2dd0-455f-9a8d-02220c591c3f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:04:44.970727 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970694 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" exitCode=0 Jun 06 19:04:44.970727 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970719 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" exitCode=0 Jun 06 19:04:44.970727 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970727 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" exitCode=0 Jun 06 19:04:44.970727 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970733 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" exitCode=0 Jun 06 19:04:44.970727 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970738 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" exitCode=0 Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970744 2548 generic.go:356] "Generic (PLEG): container finished" podID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" exitCode=0 Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970766 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970796 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970860 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970889 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970921 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970928 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970945 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970968 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} Jun 06 19:04:44.971121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.970998 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f6808f8-2dd0-455f-9a8d-02220c591c3f","Type":"ContainerDied","Data":"98d8a4fcf62b56d72593c3bd2a407557ab5275296a9b832cfd2060993f587840"} Jun 06 19:04:44.979041 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.979026 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:44.985912 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.985893 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:44.992487 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.992471 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:44.995663 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.995640 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:44.999522 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:44.999507 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.000162 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.000138 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:45.006335 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.006314 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.013258 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.013234 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.019864 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.019842 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.020111 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.020092 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.020161 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020118 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.020161 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020137 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.020361 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.020344 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.020398 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020368 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.020398 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020383 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.020647 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.020627 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.020733 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020650 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.020733 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020666 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.020887 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.020870 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.020934 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020894 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.020934 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.020910 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.021160 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.021143 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.021230 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021166 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.021230 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021187 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.021391 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.021376 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.021445 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021394 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.021445 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021406 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.021620 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:04:45.021604 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.021679 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021624 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.021679 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021637 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.021832 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021817 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.021872 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021832 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.022017 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.021995 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.022068 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022018 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.022238 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022222 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.022284 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022240 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.022458 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022442 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.022503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022459 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.022652 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022636 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.022690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022651 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.022833 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022814 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.022878 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.022834 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.023022 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023007 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.023022 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023021 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.023197 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023180 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.023239 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023198 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.023373 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023358 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.023373 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023372 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.023541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023522 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.023601 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023542 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.023740 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023724 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.023740 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023739 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.023950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023933 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.023950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.023949 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.024169 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024150 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.024237 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024169 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.024522 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024410 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.024522 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024437 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.024798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024770 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.024798 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.024796 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.025221 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025189 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.025319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025222 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.025503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025486 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.025598 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025504 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.025781 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025765 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.025844 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025783 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.026008 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.025991 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.026074 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026009 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.026219 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026201 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.026269 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026220 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.026433 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026413 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.026482 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026433 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.026482 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026474 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:45.026723 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026702 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.026786 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026724 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.026832 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026811 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="init-config-reloader" Jun 06 19:04:45.026832 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026823 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="init-config-reloader" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026835 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-thanos" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026845 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-thanos" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026858 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="prometheus" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026866 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="prometheus" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026874 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026884 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026893 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" containerName="registry" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026899 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" containerName="registry" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026907 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="thanos-sidecar" Jun 06 19:04:45.026915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026912 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="thanos-sidecar" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026924 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="config-reloader" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026933 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="config-reloader" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026946 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-web" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026954 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-web" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026966 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea37170-8e57-4cc9-acb2-52af39c29522" containerName="console" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026974 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea37170-8e57-4cc9-acb2-52af39c29522" containerName="console" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026974 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.026995 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027067 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="config-reloader" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027081 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f10034-e153-4d1b-ad85-406a45c30a60" containerName="registry" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027089 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="prometheus" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027096 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-web" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027101 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027110 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea37170-8e57-4cc9-acb2-52af39c29522" containerName="console" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027119 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="kube-rbac-proxy-thanos" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027129 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" containerName="thanos-sidecar" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027190 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.027232 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027205 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027391 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027412 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027668 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027685 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027910 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.027990 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.027936 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.028201 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028130 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.028201 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028145 2548 scope.go:117] "RemoveContainer" containerID="10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1" Jun 06 19:04:45.028362 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028343 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1"} err="failed to get container status \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": rpc error: code = NotFound desc = could not find container \"10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1\": container with ID starting with 10040d57efc54f637879c5acdfe20cb5632d9ada305ada770187270548aa1be1 not found: ID does not exist" Jun 06 19:04:45.028403 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028362 2548 scope.go:117] "RemoveContainer" containerID="5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a" Jun 06 19:04:45.028591 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028570 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a"} err="failed to get container status \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": rpc error: code = NotFound desc = could not find container \"5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a\": container with ID starting with 5b32ce6c78180d4c4fc074e3f0a20b6902cc5bdae0126fdb22e23938ce6ee31a not found: ID does not exist" Jun 06 19:04:45.028649 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028592 2548 scope.go:117] "RemoveContainer" containerID="ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3" Jun 06 19:04:45.028803 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028787 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3"} err="failed to get container status \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": rpc error: code = NotFound desc = could not find container \"ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3\": container with ID starting with ba0c3ff2c853eb34b7fbd325776c069b434b5190215338cad0b5b7b2650b29f3 not found: ID does not exist" Jun 06 19:04:45.028847 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028804 2548 scope.go:117] "RemoveContainer" containerID="f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1" Jun 06 19:04:45.028995 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028979 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1"} err="failed to get container status \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": rpc error: code = NotFound desc = could not find container \"f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1\": container with ID starting with f666f7fdd04c3ecc75cd0bc5ec076df0efff75b6243b6d4c9cf70cbe43a0bfc1 not found: ID does not exist" Jun 06 19:04:45.029042 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.028996 2548 scope.go:117] "RemoveContainer" containerID="3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d" Jun 06 19:04:45.029192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.029176 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d"} err="failed to get container status \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": rpc error: code = NotFound desc = could not find container \"3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d\": container with ID starting with 3aec934a15845bc02c6292ff8b166b0baf5cfa5758532bfc76a6adaccc7dd09d not found: ID does not exist" Jun 06 19:04:45.029192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.029191 2548 scope.go:117] "RemoveContainer" containerID="cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1" Jun 06 19:04:45.029407 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.029384 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1"} err="failed to get container status \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": rpc error: code = NotFound desc = could not find container \"cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1\": container with ID starting with cfeb944e7963cfe4c91c04417d24bd86f5cd9e613901279cdd92ab0ecf564ea1 not found: ID does not exist" Jun 06 19:04:45.029407 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.029401 2548 scope.go:117] "RemoveContainer" containerID="04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a" Jun 06 19:04:45.029597 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.029581 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a"} err="failed to get container status \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": rpc error: code = NotFound desc = could not find container \"04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a\": container with ID starting with 04b5b3bb14ee3d0d1bc5cfe4896e75a3c6375ea88b74cbaffc0673b188c7f51a not found: ID does not exist" Jun 06 19:04:45.032748 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.032732 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.035683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035632 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 19:04:45.035683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035652 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 19:04:45.035829 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035696 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 19:04:45.035886 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035862 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 19:04:45.035947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035927 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 19:04:45.035947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035934 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 19:04:45.036018 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.035981 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b5fd6\"" Jun 06 19:04:45.036087 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036069 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 19:04:45.036331 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036315 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 19:04:45.036576 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036544 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-docjll7nig5g2\"" Jun 06 19:04:45.036680 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036665 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 19:04:45.036763 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036689 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 19:04:45.036763 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.036752 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 19:04:45.037114 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.037094 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 19:04:45.037188 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.037174 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 19:04:45.038539 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.038499 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 19:04:45.041590 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.041549 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 19:04:45.047489 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.047472 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:45.145532 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145502 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145532 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145531 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145575 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145655 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145721 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145740 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145760 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145801 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145842 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbb2\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-kube-api-access-skbb2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145902 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145930 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.145947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145955 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.146349 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145975 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.146349 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.145995 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.146349 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.146038 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.146349 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.146052 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.146349 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.146073 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247308 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247337 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247356 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247414 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247435 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247450 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247466 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247490 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247548 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247606 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.247645 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247678 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skbb2\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-kube-api-access-skbb2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247712 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247745 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247780 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.247840 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248124 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.248102 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.248285 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.248503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.248341 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.249897 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.248775 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.249897 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.249201 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.250627 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.250724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.251038 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.251060 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251130 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.251122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251540 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.251465 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.251801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.251774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef161bbf-7acd-417e-8aff-c1fc427ad034-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.252362 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.252335 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.252680 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.252659 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.253236 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.253219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef161bbf-7acd-417e-8aff-c1fc427ad034-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.253236 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.253224 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.253491 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.253466 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-config\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.253601 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.253585 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.253946 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.253929 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef161bbf-7acd-417e-8aff-c1fc427ad034-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.257164 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.257145 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbb2\" (UniqueName: \"kubernetes.io/projected/ef161bbf-7acd-417e-8aff-c1fc427ad034-kube-api-access-skbb2\") pod \"prometheus-k8s-0\" (UID: \"ef161bbf-7acd-417e-8aff-c1fc427ad034\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.342823 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.342789 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:45.477807 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.477771 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 19:04:45.481126 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:04:45.481087 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef161bbf_7acd_417e_8aff_c1fc427ad034.slice/crio-cf43d2e8aa9fd71757c2b25eb323d95353d07c65a4cf85fd44277b60036ee1cc WatchSource:0}: Error finding container cf43d2e8aa9fd71757c2b25eb323d95353d07c65a4cf85fd44277b60036ee1cc: Status 404 returned error can't find the container with id cf43d2e8aa9fd71757c2b25eb323d95353d07c65a4cf85fd44277b60036ee1cc Jun 06 19:04:45.714471 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.714442 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f6808f8-2dd0-455f-9a8d-02220c591c3f" path="/var/lib/kubelet/pods/8f6808f8-2dd0-455f-9a8d-02220c591c3f/volumes" Jun 06 19:04:45.976377 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.976346 2548 generic.go:356] "Generic (PLEG): container finished" podID="ef161bbf-7acd-417e-8aff-c1fc427ad034" containerID="d352f1200b2e69ef337c50401ad8cace72d15f1b3841a7e7b254885a2befb356" exitCode=0 Jun 06 19:04:45.976541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.976440 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerDied","Data":"d352f1200b2e69ef337c50401ad8cace72d15f1b3841a7e7b254885a2befb356"} Jun 06 19:04:45.976541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:45.976519 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"cf43d2e8aa9fd71757c2b25eb323d95353d07c65a4cf85fd44277b60036ee1cc"} Jun 06 19:04:46.985406 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985370 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"44512fed957975bf30606c2b82bf5d0817b179557ec83c493f02454c1ea685a8"} Jun 06 19:04:46.985866 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985460 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"7a7564b46afbe4bf01f8d6ec2bbd6d2a8b73c6dd94b170d5af94ebe2bf93199f"} Jun 06 19:04:46.985866 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985488 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"86d6c7f725560f45d18b4fdd3b3971b0421a3fac2380dc3cda3f9921128fc259"} Jun 06 19:04:46.985866 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985512 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"7db66068b0541ab8c4da94d362875bd5c2cef7d08dc8f07c66f9c04b224781b7"} Jun 06 19:04:46.985866 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985540 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"e23223da50b44e622eaec0d2d47378db81311fff8bde65afe4c31e51e58cb53a"} Jun 06 19:04:46.985866 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:46.985581 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef161bbf-7acd-417e-8aff-c1fc427ad034","Type":"ContainerStarted","Data":"2da6a1eab6072dadd32c8765b70a13f3d723590d1776be03f13af7a81ff88297"} Jun 06 19:04:47.012021 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:47.011975 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.991752073 podStartE2EDuration="2.011954963s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.20289ms" isStatefulPod=false podCreationTimestamp="2026-06-06 19:04:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:04:47.010389144 +0000 UTC m=+365.799780929" watchObservedRunningTime="2026-06-06 19:04:47.011954963 +0000 UTC m=+365.801346748" Jun 06 19:04:50.171543 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:50.171513 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:50.219948 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:50.219909 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:50.343310 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:50.343283 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:04:55.643455 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:55.643418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:04:55.645755 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:55.645726 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0-metrics-certs\") pod \"network-metrics-daemon-8dmrz\" (UID: \"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0\") " pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:04:55.912146 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:55.912065 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-csbp9\"" Jun 06 19:04:55.920141 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:55.920123 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dmrz" Jun 06 19:04:56.047257 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:56.047224 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dmrz"] Jun 06 19:04:56.050480 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:04:56.050454 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9f978d_d65f_4f92_ac1d_9ca2ef5c5fb0.slice/crio-4ce32fe3220ad824accfb92d9b873049597853e5ca947cc957f2437975f19d7c WatchSource:0}: Error finding container 4ce32fe3220ad824accfb92d9b873049597853e5ca947cc957f2437975f19d7c: Status 404 returned error can't find the container with id 4ce32fe3220ad824accfb92d9b873049597853e5ca947cc957f2437975f19d7c Jun 06 19:04:56.052217 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:56.052201 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 19:04:57.026228 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:57.026201 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dmrz" event={"ID":"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0","Type":"ContainerStarted","Data":"4ce32fe3220ad824accfb92d9b873049597853e5ca947cc957f2437975f19d7c"} Jun 06 19:04:58.031791 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.031759 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dmrz" event={"ID":"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0","Type":"ContainerStarted","Data":"cd9856428fd59400e4bfba408d6d6cd8db95cce29c6b8eef761d9c2535ef9189"} Jun 06 19:04:58.032199 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.031810 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dmrz" event={"ID":"7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0","Type":"ContainerStarted","Data":"d423ef060bca805fdb9b9e284a2cd7beb2126bf3fee3b3a7e32ae285106f5ce6"} Jun 06 19:04:58.048235 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.048189 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8dmrz" podStartSLOduration=376.143670323 podStartE2EDuration="6m17.048170294s" totalImagesPullingTime="904.499971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 18:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:04:58.046414987 +0000 UTC m=+376.835806769" watchObservedRunningTime="2026-06-06 19:04:58.048170294 +0000 UTC m=+376.837562081" Jun 06 19:04:58.128291 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.128269 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:58.182924 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.182898 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:58.626481 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.626449 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:58.726913 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.726884 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:04:58.776333 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:04:58.776295 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:03.183095 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:03.183059 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:03.235754 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:03.235732 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:03.294247 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:03.294222 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:03.395783 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:03.395758 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:04.105830 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:04.105796 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:04.206775 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:04.206751 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:14.182804 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:14.182769 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:14.233066 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:14.233036 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:14.283896 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:14.283860 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:35.988078 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:35.988044 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:36.088595 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:36.088543 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:37.303236 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:37.303201 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:37.403758 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:37.403732 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:05:45.343677 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:45.343642 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:05:45.358968 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:45.358937 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:05:46.240940 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:05:46.240914 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 19:06:02.517383 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:02.517310 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:03.335060 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:03.335027 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:06.115162 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:06.115131 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:06.166676 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:06.166638 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:07.598414 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:07.598383 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:07.700498 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:07.700463 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:08.125170 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:08.125134 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:08.229865 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:08.229831 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:10.900573 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:10.900534 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:11.485680 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:11.485638 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:12.915655 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:12.915624 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:13.010622 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:13.010551 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:16.835317 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:16.835285 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:16.935713 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:16.935679 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:19.300144 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:19.300114 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:24.526688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:24.526649 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:24.624991 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:24.624962 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:26.557649 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.557613 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p"] Jun 06 19:06:26.561354 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.561333 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.563843 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.563816 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 19:06:26.563943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.563842 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bf5g9\"" Jun 06 19:06:26.564923 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.564902 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 19:06:26.567235 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.567215 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p"] Jun 06 19:06:26.670847 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.670815 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5fb9\" (UniqueName: \"kubernetes.io/projected/6d9b544d-c653-4379-b6fe-25ff06fc8a34-kube-api-access-s5fb9\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.671006 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.670869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d9b544d-c653-4379-b6fe-25ff06fc8a34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.772218 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.772180 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5fb9\" (UniqueName: \"kubernetes.io/projected/6d9b544d-c653-4379-b6fe-25ff06fc8a34-kube-api-access-s5fb9\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.772424 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.772245 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d9b544d-c653-4379-b6fe-25ff06fc8a34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.772610 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.772590 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d9b544d-c653-4379-b6fe-25ff06fc8a34-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.780179 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.780158 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5fb9\" (UniqueName: \"kubernetes.io/projected/6d9b544d-c653-4379-b6fe-25ff06fc8a34-kube-api-access-s5fb9\") pod \"openshift-lws-operator-fd8ccff4c-zwd8p\" (UID: \"6d9b544d-c653-4379-b6fe-25ff06fc8a34\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:26.879516 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:26.879445 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" Jun 06 19:06:27.007103 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:27.007072 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p"] Jun 06 19:06:27.010704 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:06:27.010676 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d9b544d_c653_4379_b6fe_25ff06fc8a34.slice/crio-460c5ce94e510012b9a4e6238b53f1ad55635d51b778a9956cffff5364f4f2f1 WatchSource:0}: Error finding container 460c5ce94e510012b9a4e6238b53f1ad55635d51b778a9956cffff5364f4f2f1: Status 404 returned error can't find the container with id 460c5ce94e510012b9a4e6238b53f1ad55635d51b778a9956cffff5364f4f2f1 Jun 06 19:06:27.395185 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:27.395147 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" event={"ID":"6d9b544d-c653-4379-b6fe-25ff06fc8a34","Type":"ContainerStarted","Data":"460c5ce94e510012b9a4e6238b53f1ad55635d51b778a9956cffff5364f4f2f1"} Jun 06 19:06:30.410709 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:30.410676 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" event={"ID":"6d9b544d-c653-4379-b6fe-25ff06fc8a34","Type":"ContainerStarted","Data":"9035ec0adf57ebf24f3ef14ca53be3df722a186b8a00672e85720f55300c7a27"} Jun 06 19:06:30.426619 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:30.426570 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwd8p" podStartSLOduration=1.541545053 podStartE2EDuration="4.426537208s" totalImagesPullingTime="2.884992155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:06:30.425671045 +0000 UTC m=+469.215062828" watchObservedRunningTime="2026-06-06 19:06:30.426537208 +0000 UTC m=+469.215928993" Jun 06 19:06:31.145581 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:31.145531 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:31.246775 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:31.246749 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:33.070492 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:33.070449 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:40.873072 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:40.873037 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:45.712120 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:45.712087 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:45.811550 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:45.811518 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.337766 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.337730 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.523034 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.523000 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.624321 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.624248 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.663356 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.663325 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4"] Jun 06 19:06:46.665733 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.665717 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.676698 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.676676 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 19:06:46.679585 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.679547 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 19:06:46.681236 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.681222 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 19:06:46.682050 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.682035 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f6rdl\"" Jun 06 19:06:46.682096 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.682039 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 19:06:46.730728 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.730701 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4"] Jun 06 19:06:46.735660 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.735638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.735740 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.735668 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnwc\" (UniqueName: \"kubernetes.io/projected/db389929-43ee-4913-ae7d-f0806c85a7e1-kube-api-access-wfnwc\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.735740 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.735686 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-manifests\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.735740 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.735716 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-tmp\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.735850 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.735809 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.812359 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.812330 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.836762 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.836739 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.836891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.836802 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.836891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.836832 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnwc\" (UniqueName: \"kubernetes.io/projected/db389929-43ee-4913-ae7d-f0806c85a7e1-kube-api-access-wfnwc\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.836891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.836856 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-manifests\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.836989 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.836893 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-tmp\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.837262 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.837241 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-manifests\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.839171 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.839146 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db389929-43ee-4913-ae7d-f0806c85a7e1-tmp\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.839299 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.839283 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.839460 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.839441 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db389929-43ee-4913-ae7d-f0806c85a7e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.844804 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.844783 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnwc\" (UniqueName: \"kubernetes.io/projected/db389929-43ee-4913-ae7d-f0806c85a7e1-kube-api-access-wfnwc\") pod \"opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4\" (UID: \"db389929-43ee-4913-ae7d-f0806c85a7e1\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:46.913542 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.913480 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:46.975952 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:46.975927 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:47.013180 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.013112 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:47.110979 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.110945 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:47.111461 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.111443 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4"] Jun 06 19:06:47.114438 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:06:47.114414 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb389929_43ee_4913_ae7d_f0806c85a7e1.slice/crio-68a7587057d21239ce17976f2ccb3fcc2de7e8f1e15ba2f30b5b13718176cc2c WatchSource:0}: Error finding container 68a7587057d21239ce17976f2ccb3fcc2de7e8f1e15ba2f30b5b13718176cc2c: Status 404 returned error can't find the container with id 68a7587057d21239ce17976f2ccb3fcc2de7e8f1e15ba2f30b5b13718176cc2c Jun 06 19:06:47.176787 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.176675 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:47.275397 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.275362 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:47.487931 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:47.487889 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" event={"ID":"db389929-43ee-4913-ae7d-f0806c85a7e1","Type":"ContainerStarted","Data":"68a7587057d21239ce17976f2ccb3fcc2de7e8f1e15ba2f30b5b13718176cc2c"} Jun 06 19:06:50.510716 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:50.510679 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" event={"ID":"db389929-43ee-4913-ae7d-f0806c85a7e1","Type":"ContainerStarted","Data":"c26f06fabf4b6426b2e96852bfbe434bba7b29294cab7c172171561ec996163c"} Jun 06 19:06:51.516693 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:51.516663 2548 generic.go:356] "Generic (PLEG): container finished" podID="db389929-43ee-4913-ae7d-f0806c85a7e1" containerID="c26f06fabf4b6426b2e96852bfbe434bba7b29294cab7c172171561ec996163c" exitCode=0 Jun 06 19:06:51.517066 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:51.516736 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" event={"ID":"db389929-43ee-4913-ae7d-f0806c85a7e1","Type":"ContainerDied","Data":"c26f06fabf4b6426b2e96852bfbe434bba7b29294cab7c172171561ec996163c"} Jun 06 19:06:52.522783 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:52.522741 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" event={"ID":"db389929-43ee-4913-ae7d-f0806c85a7e1","Type":"ContainerStarted","Data":"b918366092de1e406ea73e1e20ffe3915b8bc634a511c3730ae0d1be976f88f7"} Jun 06 19:06:52.523135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:52.522836 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:06:52.542271 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:52.542215 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" podStartSLOduration=2.414765959 podStartE2EDuration="6.542195668s" totalImagesPullingTime="3.163407892s" totalInitContainerRuntime="964.021817ms" isStatefulPod=false podCreationTimestamp="2026-06-06 19:06:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:06:52.540317682 +0000 UTC m=+491.329709463" watchObservedRunningTime="2026-06-06 19:06:52.542195668 +0000 UTC m=+491.331587451" Jun 06 19:06:53.852245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:53.852215 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:53.953131 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:53.953099 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:57.278834 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:57.278793 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:57.379688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:57.379654 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:06:57.495691 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:06:57.495653 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:03.529122 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:03.529090 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4" Jun 06 19:07:05.729981 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.729948 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:05.836521 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.836485 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7"] Jun 06 19:07:05.840877 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.840829 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:05.843817 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.843794 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:05.847361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.847343 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2znj6\"" Jun 06 19:07:05.848533 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.848509 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 19:07:05.848533 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.848521 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 19:07:05.848680 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.848517 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 19:07:05.853055 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.853034 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7"] Jun 06 19:07:05.906485 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.906458 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:05.906618 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.906486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-metrics-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:05.906683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.906621 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06981f0c-ea08-463f-a376-6ff1ffc66c83-manager-config\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:05.906683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:05.906640 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shx2p\" (UniqueName: \"kubernetes.io/projected/06981f0c-ea08-463f-a376-6ff1ffc66c83-kube-api-access-shx2p\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.007011 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.006948 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06981f0c-ea08-463f-a376-6ff1ffc66c83-manager-config\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.007011 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.006981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shx2p\" (UniqueName: \"kubernetes.io/projected/06981f0c-ea08-463f-a376-6ff1ffc66c83-kube-api-access-shx2p\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.007185 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.007023 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.007185 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.007137 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-metrics-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.007735 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.007716 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06981f0c-ea08-463f-a376-6ff1ffc66c83-manager-config\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.009503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.009484 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-metrics-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.009597 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.009514 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06981f0c-ea08-463f-a376-6ff1ffc66c83-cert\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.018843 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.018823 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shx2p\" (UniqueName: \"kubernetes.io/projected/06981f0c-ea08-463f-a376-6ff1ffc66c83-kube-api-access-shx2p\") pod \"lws-controller-manager-c5cb4f5cb-z5vd7\" (UID: \"06981f0c-ea08-463f-a376-6ff1ffc66c83\") " pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.153366 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.153335 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:06.288122 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.288041 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.298336 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.298304 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7"] Jun 06 19:07:06.302046 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:07:06.302016 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06981f0c_ea08_463f_a376_6ff1ffc66c83.slice/crio-2eafca7c9670069e93054e86a4006d4cc60983334fece7c80168f2ad35b449e4 WatchSource:0}: Error finding container 2eafca7c9670069e93054e86a4006d4cc60983334fece7c80168f2ad35b449e4: Status 404 returned error can't find the container with id 2eafca7c9670069e93054e86a4006d4cc60983334fece7c80168f2ad35b449e4 Jun 06 19:07:06.371357 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.371334 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.465116 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.465089 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.478116 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.478092 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w"] Jun 06 19:07:06.480917 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.480900 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.483395 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.483372 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 19:07:06.483395 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.483389 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 19:07:06.484393 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.484377 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 19:07:06.484502 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.484396 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 19:07:06.484502 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.484475 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lf5tn\"" Jun 06 19:07:06.490113 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.490093 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w"] Jun 06 19:07:06.511345 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.511323 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb1d21b6-f018-4338-9752-1a9207084fef-tls-certs\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.511431 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.511363 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q62jx\" (UniqueName: \"kubernetes.io/projected/eb1d21b6-f018-4338-9752-1a9207084fef-kube-api-access-q62jx\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.511471 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.511459 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1d21b6-f018-4338-9752-1a9207084fef-tmp\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.587960 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.587877 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" event={"ID":"06981f0c-ea08-463f-a376-6ff1ffc66c83","Type":"ContainerStarted","Data":"2eafca7c9670069e93054e86a4006d4cc60983334fece7c80168f2ad35b449e4"} Jun 06 19:07:06.601675 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.601646 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.611999 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.611929 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1d21b6-f018-4338-9752-1a9207084fef-tmp\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.612108 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.611998 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb1d21b6-f018-4338-9752-1a9207084fef-tls-certs\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.612108 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.612050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q62jx\" (UniqueName: \"kubernetes.io/projected/eb1d21b6-f018-4338-9752-1a9207084fef-kube-api-access-q62jx\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.614709 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.614686 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1d21b6-f018-4338-9752-1a9207084fef-tmp\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.614981 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.614959 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb1d21b6-f018-4338-9752-1a9207084fef-tls-certs\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.625505 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.625474 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q62jx\" (UniqueName: \"kubernetes.io/projected/eb1d21b6-f018-4338-9752-1a9207084fef-kube-api-access-q62jx\") pod \"kube-auth-proxy-5fb99459d8-5xf8w\" (UID: \"eb1d21b6-f018-4338-9752-1a9207084fef\") " pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.676211 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.676178 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.774909 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.774879 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:06.791891 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.791867 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" Jun 06 19:07:06.932861 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:06.932828 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w"] Jun 06 19:07:06.935964 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:07:06.935939 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1d21b6_f018_4338_9752_1a9207084fef.slice/crio-5912f8a7545a2e8114c118c9196888ccfdbcd0f81e24d97a0b4e2d9f42845b3a WatchSource:0}: Error finding container 5912f8a7545a2e8114c118c9196888ccfdbcd0f81e24d97a0b4e2d9f42845b3a: Status 404 returned error can't find the container with id 5912f8a7545a2e8114c118c9196888ccfdbcd0f81e24d97a0b4e2d9f42845b3a Jun 06 19:07:07.132770 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:07.132689 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:07.193404 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:07.193363 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:07.344373 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:07.344335 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:07.595787 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:07.595751 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" event={"ID":"eb1d21b6-f018-4338-9752-1a9207084fef","Type":"ContainerStarted","Data":"5912f8a7545a2e8114c118c9196888ccfdbcd0f81e24d97a0b4e2d9f42845b3a"} Jun 06 19:07:10.611942 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:10.611889 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" event={"ID":"06981f0c-ea08-463f-a376-6ff1ffc66c83","Type":"ContainerStarted","Data":"470ad73da1442a0dde72c0b8ecdeaf74c4480496de7d1d143b2db9cda841fc1c"} Jun 06 19:07:10.612340 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:10.612070 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:10.613465 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:10.613442 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" event={"ID":"eb1d21b6-f018-4338-9752-1a9207084fef","Type":"ContainerStarted","Data":"aa1943e8d310f4b5bf73404f0f1cf107554d9d12163bf610cc2703530356e6de"} Jun 06 19:07:10.628986 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:10.628939 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" podStartSLOduration=3.747678672 podStartE2EDuration="5.62892528s" totalImagesPullingTime="1.881246608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:07:10.627537299 +0000 UTC m=+509.416929084" watchObservedRunningTime="2026-06-06 19:07:10.62892528 +0000 UTC m=+509.418317064" Jun 06 19:07:10.644059 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:10.644016 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fb99459d8-5xf8w" podStartSLOduration=1.965098143 podStartE2EDuration="4.644002411s" totalImagesPullingTime="2.678904268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:07:10.64176488 +0000 UTC m=+509.431156664" watchObservedRunningTime="2026-06-06 19:07:10.644002411 +0000 UTC m=+509.433394212" Jun 06 19:07:16.622121 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:16.622080 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:16.693191 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:16.693155 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:16.797578 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:16.797530 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:16.909812 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:16.909734 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:17.880117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:17.880081 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:17.981539 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:17.981508 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:18.082045 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:18.082012 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:20.695516 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:20.695486 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:20.825526 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:20.825492 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:21.620361 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:21.620334 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c5cb4f5cb-z5vd7" Jun 06 19:07:21.842835 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:21.842804 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:21.955318 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:21.955240 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:23.045120 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:23.045087 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:23.130716 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:23.130677 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:24.866244 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:24.866208 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:33.672899 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:33.672819 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:36.027797 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:36.027760 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:36.128245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:36.128211 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:48.878229 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:48.878194 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:48.977590 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:48.977524 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:49.404864 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:49.404821 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:53.611189 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:53.611149 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:53.721500 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:53.721473 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:53.912142 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:53.912049 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:54.024881 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:54.024843 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:54.124806 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:54.124762 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:55.159815 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:55.159787 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:55.260937 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:55.260903 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:07:57.626429 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:07:57.626396 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:07.184839 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:07.184807 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:07.283438 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:07.283388 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:07.351033 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:07.351005 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:08.853515 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:08.853480 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:11.010344 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:11.010292 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:11.061825 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:11.061772 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:36.431991 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:36.431957 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:40.427770 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:40.427703 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:41.715508 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:41.715476 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:08:41.716523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:41.716504 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:08:45.832623 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:45.832589 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:46.913712 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:46.913682 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:47.885637 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.885605 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75dbcd5458-kzv59"] Jun 06 19:08:47.888905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.888889 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.892526 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892500 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892550 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892506 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892506 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892646 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892656 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v9j82\"" Jun 06 19:08:47.892688 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892506 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 19:08:47.892975 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.892715 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 19:08:47.897074 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.896942 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 19:08:47.899764 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.899741 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dbcd5458-kzv59"] Jun 06 19:08:47.929952 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.929917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-oauth-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.929960 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-oauth-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.929997 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-service-ca\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.930015 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhnmt\" (UniqueName: \"kubernetes.io/projected/12dd940d-9651-4730-b5ec-57b81c988651-kube-api-access-fhnmt\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.930036 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.930133 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-console-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.930283 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.930156 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-trusted-ca-bundle\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:47.931234 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.931214 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:47.979545 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:47.979514 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:48.031394 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031354 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-service-ca\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031398 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhnmt\" (UniqueName: \"kubernetes.io/projected/12dd940d-9651-4730-b5ec-57b81c988651-kube-api-access-fhnmt\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031475 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-console-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031495 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-trusted-ca-bundle\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031532 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-oauth-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.031606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.031603 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-oauth-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.032269 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.032224 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-console-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.032269 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.032246 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-service-ca\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.032426 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.032402 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-oauth-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.032531 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.032511 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12dd940d-9651-4730-b5ec-57b81c988651-trusted-ca-bundle\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.034087 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.034065 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-oauth-config\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.034171 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.034142 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12dd940d-9651-4730-b5ec-57b81c988651-console-serving-cert\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.039138 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.039115 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhnmt\" (UniqueName: \"kubernetes.io/projected/12dd940d-9651-4730-b5ec-57b81c988651-kube-api-access-fhnmt\") pod \"console-75dbcd5458-kzv59\" (UID: \"12dd940d-9651-4730-b5ec-57b81c988651\") " pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.200012 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.199918 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:48.331881 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:48.331844 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dbcd5458-kzv59"] Jun 06 19:08:48.334225 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:08:48.334199 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dd940d_9651_4730_b5ec_57b81c988651.slice/crio-57b2b5cda76572309a0e80543a6032ee56e43634438a3c32c945504c1c96672a WatchSource:0}: Error finding container 57b2b5cda76572309a0e80543a6032ee56e43634438a3c32c945504c1c96672a: Status 404 returned error can't find the container with id 57b2b5cda76572309a0e80543a6032ee56e43634438a3c32c945504c1c96672a Jun 06 19:08:49.060777 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:49.060732 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dbcd5458-kzv59" event={"ID":"12dd940d-9651-4730-b5ec-57b81c988651","Type":"ContainerStarted","Data":"358b5cc160b512fcc4ec76ef6caa6f5641328044dd1eae9a6b8ed9d433313f86"} Jun 06 19:08:49.061157 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:49.060796 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dbcd5458-kzv59" event={"ID":"12dd940d-9651-4730-b5ec-57b81c988651","Type":"ContainerStarted","Data":"57b2b5cda76572309a0e80543a6032ee56e43634438a3c32c945504c1c96672a"} Jun 06 19:08:49.077463 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:49.077414 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75dbcd5458-kzv59" podStartSLOduration=2.077397778 podStartE2EDuration="2.077397778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:08:49.075942264 +0000 UTC m=+607.865334048" watchObservedRunningTime="2026-06-06 19:08:49.077397778 +0000 UTC m=+607.866789629" Jun 06 19:08:51.433774 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:51.433697 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:53.568247 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:53.568212 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:54.046451 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.046424 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:54.169324 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.169287 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7"] Jun 06 19:08:54.172700 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.172670 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:54.175245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.175221 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 19:08:54.175245 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.175231 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 19:08:54.175402 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.175319 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rr9kq\"" Jun 06 19:08:54.187950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.187927 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7"] Jun 06 19:08:54.290681 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.290643 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clh5\" (UniqueName: \"kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5\") pod \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" (UID: \"25c2de07-88e6-4eaf-8a72-024dae63f819\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:54.391951 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.391846 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clh5\" (UniqueName: \"kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5\") pod \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" (UID: \"25c2de07-88e6-4eaf-8a72-024dae63f819\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:54.401513 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.401482 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clh5\" (UniqueName: \"kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5\") pod \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" (UID: \"25c2de07-88e6-4eaf-8a72-024dae63f819\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:54.483423 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.483378 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:54.616597 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:54.616570 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7"] Jun 06 19:08:54.619345 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:08:54.619318 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c2de07_88e6_4eaf_8a72_024dae63f819.slice/crio-d73a20b37616c5f0d4b3d091a8e2ae0a166ee9714ef665f5a267ba71158e96f1 WatchSource:0}: Error finding container d73a20b37616c5f0d4b3d091a8e2ae0a166ee9714ef665f5a267ba71158e96f1: Status 404 returned error can't find the container with id d73a20b37616c5f0d4b3d091a8e2ae0a166ee9714ef665f5a267ba71158e96f1 Jun 06 19:08:55.094833 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:55.094801 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" event={"ID":"25c2de07-88e6-4eaf-8a72-024dae63f819","Type":"ContainerStarted","Data":"d73a20b37616c5f0d4b3d091a8e2ae0a166ee9714ef665f5a267ba71158e96f1"} Jun 06 19:08:57.105354 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:57.105315 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" event={"ID":"25c2de07-88e6-4eaf-8a72-024dae63f819","Type":"ContainerStarted","Data":"7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc"} Jun 06 19:08:57.105820 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:57.105446 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:08:57.123051 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:57.123004 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" podStartSLOduration=1.179713574 podStartE2EDuration="3.122990776s" totalImagesPullingTime="1.943277202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:08:57.12128829 +0000 UTC m=+615.910680074" watchObservedRunningTime="2026-06-06 19:08:57.122990776 +0000 UTC m=+615.912382562" Jun 06 19:08:58.200915 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:58.200881 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:58.201339 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:58.200965 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:58.205935 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:58.205915 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:59.118277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:59.118251 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75dbcd5458-kzv59" Jun 06 19:08:59.263423 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:59.263391 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:59.369203 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:59.369125 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:08:59.426789 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:08:59.426762 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:04.275484 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.275409 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:04.355519 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.355490 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:04.368716 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.368685 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7"] Jun 06 19:09:04.369068 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.368888 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" containerName="manager" containerID="cri-o://7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc" gracePeriod=2 Jun 06 19:09:04.371485 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.371457 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:04.379296 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.378981 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7"] Jun 06 19:09:04.382338 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:04.382233 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:04.394011 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.393975 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2"] Jun 06 19:09:04.394371 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.394355 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" containerName="manager" Jun 06 19:09:04.394449 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.394374 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" containerName="manager" Jun 06 19:09:04.394503 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.394488 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" containerName="manager" Jun 06 19:09:04.397442 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.397307 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:04.399392 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:04.399365 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:04.413274 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.413248 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2"] Jun 06 19:09:04.483194 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.483155 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74xm5\" (UniqueName: \"kubernetes.io/projected/d6afabeb-d62c-4485-8465-4bc65c8f09d0-kube-api-access-74xm5\") pod \"limitador-operator-controller-manager-859d7b78bd-f9nw2\" (UID: \"d6afabeb-d62c-4485-8465-4bc65c8f09d0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:04.584052 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.584015 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xm5\" (UniqueName: \"kubernetes.io/projected/d6afabeb-d62c-4485-8465-4bc65c8f09d0-kube-api-access-74xm5\") pod \"limitador-operator-controller-manager-859d7b78bd-f9nw2\" (UID: \"d6afabeb-d62c-4485-8465-4bc65c8f09d0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:04.597932 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.597907 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74xm5\" (UniqueName: \"kubernetes.io/projected/d6afabeb-d62c-4485-8465-4bc65c8f09d0-kube-api-access-74xm5\") pod \"limitador-operator-controller-manager-859d7b78bd-f9nw2\" (UID: \"d6afabeb-d62c-4485-8465-4bc65c8f09d0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:04.615721 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.615694 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:04.618091 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:04.618066 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:04.685374 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.685339 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9clh5\" (UniqueName: \"kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5\") pod \"25c2de07-88e6-4eaf-8a72-024dae63f819\" (UID: \"25c2de07-88e6-4eaf-8a72-024dae63f819\") " Jun 06 19:09:04.687457 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.687432 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5" (OuterVolumeSpecName: "kube-api-access-9clh5") pod "25c2de07-88e6-4eaf-8a72-024dae63f819" (UID: "25c2de07-88e6-4eaf-8a72-024dae63f819"). InnerVolumeSpecName "kube-api-access-9clh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:09:04.746921 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.746883 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:04.786104 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.786068 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9clh5\" (UniqueName: \"kubernetes.io/projected/25c2de07-88e6-4eaf-8a72-024dae63f819-kube-api-access-9clh5\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:09:04.874356 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:04.874252 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2"] Jun 06 19:09:04.877081 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:09:04.877051 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6afabeb_d62c_4485_8465_4bc65c8f09d0.slice/crio-51cae191cb6da3572b1ba2222b50de5a58acb709ad56ca9d11dc140b3222d9c5 WatchSource:0}: Error finding container 51cae191cb6da3572b1ba2222b50de5a58acb709ad56ca9d11dc140b3222d9c5: Status 404 returned error can't find the container with id 51cae191cb6da3572b1ba2222b50de5a58acb709ad56ca9d11dc140b3222d9c5 Jun 06 19:09:05.148831 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.148741 2548 generic.go:356] "Generic (PLEG): container finished" podID="25c2de07-88e6-4eaf-8a72-024dae63f819" containerID="7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc" exitCode=0 Jun 06 19:09:05.148831 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.148783 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:05.148831 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.148824 2548 scope.go:117] "RemoveContainer" containerID="7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc" Jun 06 19:09:05.150523 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.150496 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" event={"ID":"d6afabeb-d62c-4485-8465-4bc65c8f09d0","Type":"ContainerStarted","Data":"fb6c1d6d38d192e78fce8d9ee73936bdb2896bb8f25e4c8b6eb19b4f46665f58"} Jun 06 19:09:05.150663 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.150579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:05.150663 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.150607 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" event={"ID":"d6afabeb-d62c-4485-8465-4bc65c8f09d0","Type":"ContainerStarted","Data":"51cae191cb6da3572b1ba2222b50de5a58acb709ad56ca9d11dc140b3222d9c5"} Jun 06 19:09:05.150909 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:05.150877 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:05.152751 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:05.152726 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:05.158348 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.158334 2548 scope.go:117] "RemoveContainer" containerID="7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc" Jun 06 19:09:05.158584 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:05.158568 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc\": container with ID starting with 7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc not found: ID does not exist" containerID="7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc" Jun 06 19:09:05.158640 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.158591 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc"} err="failed to get container status \"7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc\": rpc error: code = NotFound desc = could not find container \"7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc\": container with ID starting with 7c2ab48f2cc707dcb6a5258b053dc17ba501132846f23a401fc478bb34aea8dc not found: ID does not exist" Jun 06 19:09:05.169465 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.169423 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" podStartSLOduration=1.169411905 podStartE2EDuration="1.169411905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:09:05.168912358 +0000 UTC m=+623.958304144" watchObservedRunningTime="2026-06-06 19:09:05.169411905 +0000 UTC m=+623.958803691" Jun 06 19:09:05.170798 ip-10-0-130-40 kubenswrapper[2548]: E0606 19:09:05.170774 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4rxs7\" is forbidden: User \"system:node:ip-10-0-130-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-40.ec2.internal' and this object" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4rxs7" Jun 06 19:09:05.714022 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:05.713992 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c2de07-88e6-4eaf-8a72-024dae63f819" path="/var/lib/kubelet/pods/25c2de07-88e6-4eaf-8a72-024dae63f819/volumes" Jun 06 19:09:06.265454 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:06.265428 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:07.695791 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:07.695751 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:09.065961 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:09.065931 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:10.825414 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:10.825379 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:10.950493 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:10.950463 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:11.047832 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:11.047804 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:11.147735 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:11.147653 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:15.024978 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:15.024939 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:15.124633 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:15.124603 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:16.158279 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:16.158253 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f9nw2" Jun 06 19:09:18.826002 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:18.825968 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:18.927083 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:18.927047 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:22.437319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:22.437283 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:22.534881 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:22.534851 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:31.033548 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:31.033508 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:31.130060 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:31.130025 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:31.188631 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:31.188598 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:34.034391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:34.034357 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:34.137691 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:34.137657 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:36.397882 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:36.397851 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:36.498031 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:36.498001 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:36.641547 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:36.641472 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:36.747284 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:36.747255 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:39.898603 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:39.898566 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:40.433416 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:40.433386 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:40.490780 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:40.490751 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:50.444096 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:50.444056 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:50.541354 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:50.541322 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:52.189374 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.189339 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:52.302672 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.302644 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:52.351530 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.351498 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:52.519972 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.519932 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:09:52.524692 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.524652 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.527389 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.527369 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9gttf\"" Jun 06 19:09:52.527705 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.527686 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 19:09:52.532457 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.532434 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:09:52.557473 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.557446 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:09:52.604433 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.604406 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c26ee03f-cd83-4cb1-bac5-934a823b8396-config-file\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.604607 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.604462 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x854\" (UniqueName: \"kubernetes.io/projected/c26ee03f-cd83-4cb1-bac5-934a823b8396-kube-api-access-8x854\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.705282 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.705248 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x854\" (UniqueName: \"kubernetes.io/projected/c26ee03f-cd83-4cb1-bac5-934a823b8396-kube-api-access-8x854\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.705451 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.705343 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c26ee03f-cd83-4cb1-bac5-934a823b8396-config-file\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.705959 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.705940 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c26ee03f-cd83-4cb1-bac5-934a823b8396-config-file\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.715446 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.715423 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x854\" (UniqueName: \"kubernetes.io/projected/c26ee03f-cd83-4cb1-bac5-934a823b8396-kube-api-access-8x854\") pod \"limitador-limitador-54d6d988d5-8pcmh\" (UID: \"c26ee03f-cd83-4cb1-bac5-934a823b8396\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.837585 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.837476 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:52.968653 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:52.968626 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:09:52.970522 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:09:52.970483 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26ee03f_cd83_4cb1_bac5_934a823b8396.slice/crio-bdd1a84ed861522f7a8a44f760c57821a80fe6d8661410c8abc84f4b261d8315 WatchSource:0}: Error finding container bdd1a84ed861522f7a8a44f760c57821a80fe6d8661410c8abc84f4b261d8315: Status 404 returned error can't find the container with id bdd1a84ed861522f7a8a44f760c57821a80fe6d8661410c8abc84f4b261d8315 Jun 06 19:09:53.009410 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:53.009382 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:53.103125 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:53.103051 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:53.376641 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:53.376549 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" event={"ID":"c26ee03f-cd83-4cb1-bac5-934a823b8396","Type":"ContainerStarted","Data":"bdd1a84ed861522f7a8a44f760c57821a80fe6d8661410c8abc84f4b261d8315"} Jun 06 19:09:53.445875 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:53.445824 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:53.543286 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:53.543251 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:09:56.395647 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:56.395608 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" event={"ID":"c26ee03f-cd83-4cb1-bac5-934a823b8396","Type":"ContainerStarted","Data":"9d57efab30610421c5f1339a4eb30b1985a5e6d56f41f444993e2ef3fd6dbebb"} Jun 06 19:09:56.396119 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:56.395776 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:09:56.411114 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:09:56.411056 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" podStartSLOduration=1.848831363 podStartE2EDuration="4.411040291s" totalImagesPullingTime="2.562208928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:09:56.410223701 +0000 UTC m=+675.199615486" watchObservedRunningTime="2026-06-06 19:09:56.411040291 +0000 UTC m=+675.200432075" Jun 06 19:10:07.402023 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:07.401989 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8pcmh" Jun 06 19:10:11.718794 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:11.718760 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:10:21.700760 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:21.700716 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:10:21.797782 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:21.797752 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:10:21.937177 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:21.937150 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:10:50.844122 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:50.844094 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:10:50.899352 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:10:50.899321 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:21.337072 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:21.337039 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:22.025677 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:22.025640 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:30.185395 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:30.185364 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:30.286021 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:30.285982 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:51.013364 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:51.013333 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:59.127100 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.127071 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:59.249800 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.249751 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:59.518355 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.518327 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:59.599913 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.599865 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:11:59.640952 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.640925 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h77z4"] Jun 06 19:11:59.645703 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.645683 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:11:59.648849 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.648832 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 19:11:59.648943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.648889 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gqkcl\"" Jun 06 19:11:59.655336 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.655314 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h77z4"] Jun 06 19:11:59.700206 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.700168 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzm4l\" (UniqueName: \"kubernetes.io/projected/6202204a-ef56-4c5c-84d4-79b9a7636ccd-kube-api-access-hzm4l\") pod \"payload-processing-7c6c859784-h77z4\" (UID: \"6202204a-ef56-4c5c-84d4-79b9a7636ccd\") " pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:11:59.801406 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.801336 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzm4l\" (UniqueName: \"kubernetes.io/projected/6202204a-ef56-4c5c-84d4-79b9a7636ccd-kube-api-access-hzm4l\") pod \"payload-processing-7c6c859784-h77z4\" (UID: \"6202204a-ef56-4c5c-84d4-79b9a7636ccd\") " pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:11:59.808623 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.808604 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzm4l\" (UniqueName: \"kubernetes.io/projected/6202204a-ef56-4c5c-84d4-79b9a7636ccd-kube-api-access-hzm4l\") pod \"payload-processing-7c6c859784-h77z4\" (UID: \"6202204a-ef56-4c5c-84d4-79b9a7636ccd\") " pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:11:59.956662 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:11:59.956635 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:12:00.067541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:00.067461 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:12:00.086303 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:00.086280 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h77z4"] Jun 06 19:12:00.088938 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:12:00.088913 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6202204a_ef56_4c5c_84d4_79b9a7636ccd.slice/crio-d845ec7fcfcbd0af6a58d2437dcbb0c66157574341811e0b602ecde70482d754 WatchSource:0}: Error finding container d845ec7fcfcbd0af6a58d2437dcbb0c66157574341811e0b602ecde70482d754: Status 404 returned error can't find the container with id d845ec7fcfcbd0af6a58d2437dcbb0c66157574341811e0b602ecde70482d754 Jun 06 19:12:00.090838 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:00.090819 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 19:12:00.990480 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:00.990446 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" event={"ID":"6202204a-ef56-4c5c-84d4-79b9a7636ccd","Type":"ContainerStarted","Data":"d845ec7fcfcbd0af6a58d2437dcbb0c66157574341811e0b602ecde70482d754"} Jun 06 19:12:03.001401 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:03.001366 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" event={"ID":"6202204a-ef56-4c5c-84d4-79b9a7636ccd","Type":"ContainerStarted","Data":"3370ac910ec2cbd41d7822b6e8bbd247d7bff8821931499afb613332b5bec8fe"} Jun 06 19:12:03.001888 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:03.001456 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:12:03.016492 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:03.016440 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" podStartSLOduration=1.817550958 podStartE2EDuration="4.016422921s" totalImagesPullingTime="2.198871963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:12:03.015515451 +0000 UTC m=+801.804907233" watchObservedRunningTime="2026-06-06 19:12:03.016422921 +0000 UTC m=+801.805814705" Jun 06 19:12:14.009211 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:14.009178 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-h77z4" Jun 06 19:12:34.138527 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:34.138471 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:12:34.186618 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:34.186587 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:12:59.787438 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:59.787378 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:12:59.885246 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:12:59.885218 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:07.769453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:07.769404 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:07.985693 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:07.985655 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:13:20.107450 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:20.107417 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:20.207842 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:20.207812 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:31.495819 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:31.495715 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:32.171681 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:32.171644 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:13:36.450290 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:36.450257 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:40.176313 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:40.176277 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:13:40.961240 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:40.961204 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:13:41.746778 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:41.746746 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:13:41.747211 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:13:41.746803 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:14:11.950697 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:11.950664 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:14:13.010110 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:13.010080 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:14:14.336867 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.336835 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg"] Jun 06 19:14:14.340480 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.340452 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.344164 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.344111 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 19:14:14.344312 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.344171 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 19:14:14.344312 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.344175 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nshzk\"" Jun 06 19:14:14.344312 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.344285 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 06 19:14:14.352790 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.352765 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg"] Jun 06 19:14:14.363247 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.363221 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:14:14.494139 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494089 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.494317 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494145 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.494317 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494242 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.494317 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494294 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.494441 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494400 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ae35a4-6c60-4853-bf41-e4466737988e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.494441 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.494417 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6f6\" (UniqueName: \"kubernetes.io/projected/32ae35a4-6c60-4853-bf41-e4466737988e-kube-api-access-wd6f6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.595945 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.595837 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.595945 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.595899 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.595956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ae35a4-6c60-4853-bf41-e4466737988e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.595975 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6f6\" (UniqueName: \"kubernetes.io/projected/32ae35a4-6c60-4853-bf41-e4466737988e-kube-api-access-wd6f6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.596104 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.596166 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596416 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.596271 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596547 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.596511 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.596547 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.596539 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.598302 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.598273 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ae35a4-6c60-4853-bf41-e4466737988e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.598604 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.598584 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ae35a4-6c60-4853-bf41-e4466737988e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.603951 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.603927 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6f6\" (UniqueName: \"kubernetes.io/projected/32ae35a4-6c60-4853-bf41-e4466737988e-kube-api-access-wd6f6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg\" (UID: \"32ae35a4-6c60-4853-bf41-e4466737988e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.651008 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.650974 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:14.786689 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:14.786663 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg"] Jun 06 19:14:14.788619 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:14:14.788592 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ae35a4_6c60_4853_bf41_e4466737988e.slice/crio-38dff144a3e0ae2cc6e35c6272caec48b58432312ded0db104961ec4cce46cad WatchSource:0}: Error finding container 38dff144a3e0ae2cc6e35c6272caec48b58432312ded0db104961ec4cce46cad: Status 404 returned error can't find the container with id 38dff144a3e0ae2cc6e35c6272caec48b58432312ded0db104961ec4cce46cad Jun 06 19:14:15.066195 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:15.066151 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:14:15.633079 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:15.633039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" event={"ID":"32ae35a4-6c60-4853-bf41-e4466737988e","Type":"ContainerStarted","Data":"38dff144a3e0ae2cc6e35c6272caec48b58432312ded0db104961ec4cce46cad"} Jun 06 19:14:18.652125 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:18.652089 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" event={"ID":"32ae35a4-6c60-4853-bf41-e4466737988e","Type":"ContainerStarted","Data":"f34260098dc0714c3633276ccfe59aee7689bec7cd898d03ebabecc18794715a"} Jun 06 19:14:18.666479 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:18.666451 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:14:19.658170 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:19.658075 2548 generic.go:356] "Generic (PLEG): container finished" podID="32ae35a4-6c60-4853-bf41-e4466737988e" containerID="f34260098dc0714c3633276ccfe59aee7689bec7cd898d03ebabecc18794715a" exitCode=0 Jun 06 19:14:19.658170 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:19.658129 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" event={"ID":"32ae35a4-6c60-4853-bf41-e4466737988e","Type":"ContainerDied","Data":"f34260098dc0714c3633276ccfe59aee7689bec7cd898d03ebabecc18794715a"} Jun 06 19:14:20.172045 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:20.172010 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:14:21.669387 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:21.669356 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" event={"ID":"32ae35a4-6c60-4853-bf41-e4466737988e","Type":"ContainerStarted","Data":"2b7e5eb80f557cb592c8f44418dfcabeed7db26de93febd5b0a4ec61fb5c2d21"} Jun 06 19:14:21.688447 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:21.688396 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" podStartSLOduration=2.22493738 podStartE2EDuration="7.688379804s" totalImagesPullingTime="4.105616161s" totalInitContainerRuntime="1.357826263s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:14:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:14:21.68606718 +0000 UTC m=+940.475458963" watchObservedRunningTime="2026-06-06 19:14:21.688379804 +0000 UTC m=+940.477771639" Jun 06 19:14:24.651522 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:24.651483 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:24.651961 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:24.651543 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:24.664181 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:24.664151 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:24.696210 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:24.696183 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg" Jun 06 19:14:28.473358 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:28.473314 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:14:29.978140 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:14:29.978101 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:15:00.135237 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.135202 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29679555-v8fp5"] Jun 06 19:15:00.137730 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.137715 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:00.140160 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.140138 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8tkgv\"" Jun 06 19:15:00.145398 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.145300 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679555-v8fp5"] Jun 06 19:15:00.301924 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.301845 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5b4\" (UniqueName: \"kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4\") pod \"maas-api-key-cleanup-29679555-v8fp5\" (UID: \"9c9bd0ed-0a2d-417a-98d2-27e19371c43d\") " pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:00.402542 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.402467 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5b4\" (UniqueName: \"kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4\") pod \"maas-api-key-cleanup-29679555-v8fp5\" (UID: \"9c9bd0ed-0a2d-417a-98d2-27e19371c43d\") " pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:00.409922 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.409901 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5b4\" (UniqueName: \"kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4\") pod \"maas-api-key-cleanup-29679555-v8fp5\" (UID: \"9c9bd0ed-0a2d-417a-98d2-27e19371c43d\") " pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:00.449035 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.449016 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:00.573774 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.573747 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679555-v8fp5"] Jun 06 19:15:00.576474 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:15:00.576446 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9bd0ed_0a2d_417a_98d2_27e19371c43d.slice/crio-6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9 WatchSource:0}: Error finding container 6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9: Status 404 returned error can't find the container with id 6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9 Jun 06 19:15:00.853023 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:00.852985 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" event={"ID":"9c9bd0ed-0a2d-417a-98d2-27e19371c43d","Type":"ContainerStarted","Data":"6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9"} Jun 06 19:15:03.870269 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:03.870189 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" event={"ID":"9c9bd0ed-0a2d-417a-98d2-27e19371c43d","Type":"ContainerStarted","Data":"a655d2eec0e41575c72317b9d9f7e29d1e19a2ef107ad7ae204622d83addd5d3"} Jun 06 19:15:03.884961 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:03.884917 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" podStartSLOduration=1.309815166 podStartE2EDuration="3.884901002s" totalImagesPullingTime="2.575085836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:15:03.883731575 +0000 UTC m=+982.673123359" watchObservedRunningTime="2026-06-06 19:15:03.884901002 +0000 UTC m=+982.674292764" Jun 06 19:15:04.876216 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:04.876184 2548 generic.go:356] "Generic (PLEG): container finished" podID="9c9bd0ed-0a2d-417a-98d2-27e19371c43d" containerID="a655d2eec0e41575c72317b9d9f7e29d1e19a2ef107ad7ae204622d83addd5d3" exitCode=0 Jun 06 19:15:04.876602 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:04.876269 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" event={"ID":"9c9bd0ed-0a2d-417a-98d2-27e19371c43d","Type":"ContainerDied","Data":"a655d2eec0e41575c72317b9d9f7e29d1e19a2ef107ad7ae204622d83addd5d3"} Jun 06 19:15:06.008382 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.008359 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:06.153142 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.153072 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps5b4\" (UniqueName: \"kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4\") pod \"9c9bd0ed-0a2d-417a-98d2-27e19371c43d\" (UID: \"9c9bd0ed-0a2d-417a-98d2-27e19371c43d\") " Jun 06 19:15:06.155180 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.155148 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4" (OuterVolumeSpecName: "kube-api-access-ps5b4") pod "9c9bd0ed-0a2d-417a-98d2-27e19371c43d" (UID: "9c9bd0ed-0a2d-417a-98d2-27e19371c43d"). InnerVolumeSpecName "kube-api-access-ps5b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:15:06.254149 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.254122 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps5b4\" (UniqueName: \"kubernetes.io/projected/9c9bd0ed-0a2d-417a-98d2-27e19371c43d-kube-api-access-ps5b4\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:15:06.886933 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.886900 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" Jun 06 19:15:06.886933 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.886930 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679555-v8fp5" event={"ID":"9c9bd0ed-0a2d-417a-98d2-27e19371c43d","Type":"ContainerDied","Data":"6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9"} Jun 06 19:15:06.887135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:06.886972 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f3ec0d5c1d9ddc3ae54b41ee31b754320fb2a8efda0cae50db59b74806543f9" Jun 06 19:15:16.911939 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:16.911902 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:15:17.010253 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:17.010222 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:15:17.991117 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:17.991079 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:15:18.092171 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:18.092139 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:15:39.175640 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:39.175601 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:15:45.173594 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:45.173543 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:15:51.168729 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:15:51.168689 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:00.371375 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:00.371343 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:09.865590 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:09.865546 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:19.075436 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:19.075403 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:28.670261 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:28.670227 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:38.762777 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:38.762690 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:16:46.176607 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:46.176551 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:16:46.276911 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:16:46.276875 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:27.329154 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:27.329121 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:27.429171 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:27.429130 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:35.680773 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:35.680717 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:41.528340 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:41.528309 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:41.628862 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:41.628818 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:17:52.469967 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:17:52.469932 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:18:07.071291 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:07.071206 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:18:13.657782 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:13.657740 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:13.749206 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:13.749175 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:37.449049 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:37.449008 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:41.783759 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:41.783729 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:18:41.788451 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:41.788416 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:18:43.067785 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:43.067755 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:43.176695 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:43.176661 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:43.267694 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:43.267663 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:43.424190 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:43.424105 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:43.523790 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:43.523753 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:18:46.368608 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:46.368572 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:18:59.939265 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:18:59.939233 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:00.046438 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:00.046408 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:00.152609 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:00.152576 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:01.573150 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:01.573116 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:19:05.762621 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:05.762587 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:05.862697 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:05.862668 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:13.896301 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:13.896261 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:15.015843 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:15.015810 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:16.267615 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:16.267583 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:19:30.613191 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:30.613109 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:30.713194 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:30.713162 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:30.819134 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:30.819098 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:32.062131 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:32.062099 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:19:36.505616 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:36.505580 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:19:36.604313 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:19:36.604288 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:20:27.965716 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:20:27.965678 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:20:37.174612 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:20:37.174578 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:20:54.863056 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:20:54.863026 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:21:04.268089 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:21:04.268005 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:21:19.476388 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:21:19.476357 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:21:29.267335 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:21:29.267293 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:01.471103 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:01.471061 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:10.071687 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:10.071647 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:19.058302 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:19.058265 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:27.269629 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:27.269589 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:35.970052 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:35.969976 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:22:52.468949 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:22:52.468909 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:23:04.169133 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:04.169089 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:23:17.424432 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:17.424393 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:23:17.470879 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:17.470828 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:23:41.813530 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:41.813503 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:23:41.820391 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:41.820372 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:23:50.770148 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:50.770108 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:23:57.778541 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:23:57.778507 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:04.265796 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:04.265709 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:13.765194 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:13.765154 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:23.366345 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:23.366305 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:29.874285 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:29.874251 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:40.673592 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:40.673532 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:49.867907 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:49.867862 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:24:58.868610 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:24:58.868573 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:06.077502 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:06.077463 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:14.571674 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:14.571632 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:23.371951 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:23.371909 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:33.166202 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:33.166118 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:40.572667 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:40.572631 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:48.972618 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:48.972585 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:25:55.480877 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:55.480847 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:25:56.612389 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:56.612351 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:25:57.668214 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:25:57.668181 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:26:06.266946 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:26:06.266915 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:26:15.174519 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:26:15.174487 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:26:23.570315 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:26:23.570280 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:26:31.571495 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:26:31.571455 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:28:33.666210 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:28:33.666123 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:28:41.844084 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:28:41.844056 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:28:41.850910 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:28:41.850891 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:28:42.675027 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:28:42.674994 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:05.268358 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:05.268317 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:13.676135 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:13.676097 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:23.168163 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:23.168124 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:32.169388 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:32.169354 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:40.981922 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:40.981885 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:29:52.378991 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:29:52.378956 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:30:00.148575 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.148520 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29679570-pz4qt"] Jun 06 19:30:00.149005 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.148940 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9bd0ed-0a2d-417a-98d2-27e19371c43d" containerName="cleanup" Jun 06 19:30:00.149005 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.148952 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9bd0ed-0a2d-417a-98d2-27e19371c43d" containerName="cleanup" Jun 06 19:30:00.149115 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.149043 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9bd0ed-0a2d-417a-98d2-27e19371c43d" containerName="cleanup" Jun 06 19:30:00.150950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.150935 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:00.153472 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.153453 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8tkgv\"" Jun 06 19:30:00.171624 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.171593 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679570-pz4qt"] Jun 06 19:30:00.252477 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.252409 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8pt\" (UniqueName: \"kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt\") pod \"maas-api-key-cleanup-29679570-pz4qt\" (UID: \"fd6699ee-7450-48bd-9379-9402ffe1fa84\") " pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:00.353743 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.353709 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8pt\" (UniqueName: \"kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt\") pod \"maas-api-key-cleanup-29679570-pz4qt\" (UID: \"fd6699ee-7450-48bd-9379-9402ffe1fa84\") " pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:00.361819 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.361792 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8pt\" (UniqueName: \"kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt\") pod \"maas-api-key-cleanup-29679570-pz4qt\" (UID: \"fd6699ee-7450-48bd-9379-9402ffe1fa84\") " pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:00.460676 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.460597 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:00.586691 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:00.586664 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679570-pz4qt"] Jun 06 19:30:00.589291 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:30:00.589262 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6699ee_7450_48bd_9379_9402ffe1fa84.slice/crio-0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f WatchSource:0}: Error finding container 0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f: Status 404 returned error can't find the container with id 0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f Jun 06 19:30:01.216516 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:01.216419 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" event={"ID":"fd6699ee-7450-48bd-9379-9402ffe1fa84","Type":"ContainerStarted","Data":"a6f0ae996df685b8f46e628f0b919b38f20603f3a193c5b2184b27a0e109099a"} Jun 06 19:30:01.216516 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:01.216504 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" event={"ID":"fd6699ee-7450-48bd-9379-9402ffe1fa84","Type":"ContainerStarted","Data":"0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f"} Jun 06 19:30:01.242988 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:01.242936 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" podStartSLOduration=1.242921115 podStartE2EDuration="1.242921115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:30:01.241631183 +0000 UTC m=+1880.031022967" watchObservedRunningTime="2026-06-06 19:30:01.242921115 +0000 UTC m=+1880.032312899" Jun 06 19:30:02.073802 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:02.073767 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:30:02.222472 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:02.222436 2548 generic.go:356] "Generic (PLEG): container finished" podID="fd6699ee-7450-48bd-9379-9402ffe1fa84" containerID="a6f0ae996df685b8f46e628f0b919b38f20603f3a193c5b2184b27a0e109099a" exitCode=0 Jun 06 19:30:02.222881 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:02.222513 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" event={"ID":"fd6699ee-7450-48bd-9379-9402ffe1fa84","Type":"ContainerDied","Data":"a6f0ae996df685b8f46e628f0b919b38f20603f3a193c5b2184b27a0e109099a"} Jun 06 19:30:03.352728 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:03.352706 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:03.482091 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:03.482014 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv8pt\" (UniqueName: \"kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt\") pod \"fd6699ee-7450-48bd-9379-9402ffe1fa84\" (UID: \"fd6699ee-7450-48bd-9379-9402ffe1fa84\") " Jun 06 19:30:03.483991 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:03.483967 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt" (OuterVolumeSpecName: "kube-api-access-nv8pt") pod "fd6699ee-7450-48bd-9379-9402ffe1fa84" (UID: "fd6699ee-7450-48bd-9379-9402ffe1fa84"). InnerVolumeSpecName "kube-api-access-nv8pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 19:30:03.583371 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:03.583344 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv8pt\" (UniqueName: \"kubernetes.io/projected/fd6699ee-7450-48bd-9379-9402ffe1fa84-kube-api-access-nv8pt\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jun 06 19:30:04.234916 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:04.234888 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" Jun 06 19:30:04.235086 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:04.234919 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679570-pz4qt" event={"ID":"fd6699ee-7450-48bd-9379-9402ffe1fa84","Type":"ContainerDied","Data":"0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f"} Jun 06 19:30:04.235086 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:04.234962 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eb225db1d6430e626f43435ce258f81c0ea505feca00bd281699b7fdc0d293f" Jun 06 19:30:11.378381 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:11.378346 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:30:15.124675 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:15.124638 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:30:15.207313 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:15.207276 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:30:20.575007 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:20.574972 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:30:31.596618 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:31.596571 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:30:39.777972 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:30:39.777938 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:31:14.868673 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:31:14.868637 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:31:57.383285 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:31:57.383246 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:04.042868 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:04.042825 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:32:06.064001 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:06.063968 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:14.969867 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:14.969820 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:24.378177 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:24.378135 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:33.272039 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:33.272001 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:47.072123 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:47.072087 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:32:55.974389 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:32:55.974354 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:00.215778 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:00.215689 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:33:06.970297 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:06.970259 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:15.778134 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:15.778096 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:22.174038 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:22.174002 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:30.672485 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:30.672452 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:41.882277 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:41.882248 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:33:41.890533 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:41.890512 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:33:42.366690 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:42.366659 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:33:59.677013 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:33:59.676970 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:08.873490 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:08.873450 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:17.468819 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:17.468786 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:23.866177 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:23.866144 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:43.174371 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:43.174336 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:51.471862 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:51.471827 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:34:58.769231 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:34:58.769199 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:07.068946 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:07.068896 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:17.470417 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:17.470371 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:24.172722 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:24.172682 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:34.666306 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:34.666270 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:43.318272 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:43.318237 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:35:43.403879 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:43.403845 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:35:47.266988 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:47.266958 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:55.380793 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:55.380762 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:35:58.535493 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:35:58.535464 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:36:08.866320 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:36:08.866239 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:36:18.778865 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:36:18.778826 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:36:29.683668 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:36:29.683631 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:36:35.873758 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:36:35.873723 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:36:45.784408 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:36:45.784375 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:37:04.573627 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:04.573595 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:37:11.274314 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:11.274276 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:37:18.510943 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:18.510888 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:37:21.369890 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:21.369856 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:37:28.108109 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:28.108057 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:37:31.967638 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:31.967539 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:37:52.363807 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:52.363774 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:37:54.372743 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:37:54.372706 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:38:05.396702 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:05.396670 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:38:06.678129 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:06.678075 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8pcmh"] Jun 06 19:38:17.800497 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:17.800460 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679555-v8fp5_9c9bd0ed-0a2d-417a-98d2-27e19371c43d/cleanup/0.log" Jun 06 19:38:17.912434 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:17.912401 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679570-pz4qt_fd6699ee-7450-48bd-9379-9402ffe1fa84/cleanup/0.log" Jun 06 19:38:18.600497 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:18.600465 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4_db389929-43ee-4913-ae7d-f0806c85a7e1/copy-manifests/0.log" Jun 06 19:38:18.607366 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:18.607342 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4_db389929-43ee-4913-ae7d-f0806c85a7e1/manager/0.log" Jun 06 19:38:20.643540 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:20.643509 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8pcmh_c26ee03f-cd83-4cb1-bac5-934a823b8396/limitador/0.log" Jun 06 19:38:20.759568 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:20.759526 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f9nw2_d6afabeb-d62c-4485-8465-4bc65c8f09d0/manager/0.log" Jun 06 19:38:21.330453 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:21.330421 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb99459d8-5xf8w_eb1d21b6-f018-4338-9752-1a9207084fef/kube-auth-proxy/0.log" Jun 06 19:38:21.773175 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:21.773138 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h77z4_6202204a-ef56-4c5c-84d4-79b9a7636ccd/payload-processing/0.log" Jun 06 19:38:22.564979 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:22.564935 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg_32ae35a4-6c60-4853-bf41-e4466737988e/storage-initializer/0.log" Jun 06 19:38:22.573164 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:22.573140 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjngmg_32ae35a4-6c60-4853-bf41-e4466737988e/main/0.log" Jun 06 19:38:27.266371 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.266335 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ss2g/must-gather-f2p5x"] Jun 06 19:38:27.266905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.266756 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6699ee-7450-48bd-9379-9402ffe1fa84" containerName="cleanup" Jun 06 19:38:27.266905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.266767 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6699ee-7450-48bd-9379-9402ffe1fa84" containerName="cleanup" Jun 06 19:38:27.266905 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.266852 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6699ee-7450-48bd-9379-9402ffe1fa84" containerName="cleanup" Jun 06 19:38:27.269842 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.269806 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:38:27.270526 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.270511 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.272947 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.272926 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ss2g\"/\"openshift-service-ca.crt\"" Jun 06 19:38:27.273066 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.272974 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ss2g\"/\"kube-root-ca.crt\"" Jun 06 19:38:27.273952 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.273933 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ss2g\"/\"default-dockercfg-6p22w\"" Jun 06 19:38:27.285335 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.285307 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ss2g/must-gather-f2p5x"] Jun 06 19:38:27.369357 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.369327 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" limit=1024 Jun 06 19:38:27.384519 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.384489 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvzn\" (UniqueName: \"kubernetes.io/projected/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-kube-api-access-wzvzn\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.384696 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.384529 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-must-gather-output\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.485606 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.485542 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvzn\" (UniqueName: \"kubernetes.io/projected/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-kube-api-access-wzvzn\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.485802 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.485615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-must-gather-output\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.485965 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.485945 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-must-gather-output\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.493605 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.493571 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvzn\" (UniqueName: \"kubernetes.io/projected/82d7cb5a-62ea-4447-b4d1-0441daeaf50f-kube-api-access-wzvzn\") pod \"must-gather-f2p5x\" (UID: \"82d7cb5a-62ea-4447-b4d1-0441daeaf50f\") " pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.580043 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.579954 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" Jun 06 19:38:27.725861 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.725838 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ss2g/must-gather-f2p5x"] Jun 06 19:38:27.728057 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:38:27.728019 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d7cb5a_62ea_4447_b4d1_0441daeaf50f.slice/crio-c1d487d7eb4cb42ab2e68a31a549130232ed38660f6241292c01ff5ede2df91a WatchSource:0}: Error finding container c1d487d7eb4cb42ab2e68a31a549130232ed38660f6241292c01ff5ede2df91a: Status 404 returned error can't find the container with id c1d487d7eb4cb42ab2e68a31a549130232ed38660f6241292c01ff5ede2df91a Jun 06 19:38:27.730042 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:27.730021 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 19:38:28.688664 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:28.688638 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" event={"ID":"82d7cb5a-62ea-4447-b4d1-0441daeaf50f","Type":"ContainerStarted","Data":"c1d487d7eb4cb42ab2e68a31a549130232ed38660f6241292c01ff5ede2df91a"} Jun 06 19:38:29.698574 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:29.698517 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" event={"ID":"82d7cb5a-62ea-4447-b4d1-0441daeaf50f","Type":"ContainerStarted","Data":"e5e841fbe20f23ba84a178627f5f41cdf2cea1cdff989589c16b32fed24e4446"} Jun 06 19:38:29.699040 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:29.698597 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" event={"ID":"82d7cb5a-62ea-4447-b4d1-0441daeaf50f","Type":"ContainerStarted","Data":"df75f2f3fd6751461921cad2eb9ed077b55a9fe652fe47334767d5f58425c102"} Jun 06 19:38:29.720593 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:29.714834 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ss2g/must-gather-f2p5x" podStartSLOduration=1.7835657249999999 podStartE2EDuration="2.714814376s" totalImagesPullingTime="931.248651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 19:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:38:29.712606481 +0000 UTC m=+2388.501998268" watchObservedRunningTime="2026-06-06 19:38:29.714814376 +0000 UTC m=+2388.504206162" Jun 06 19:38:30.574615 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:30.574586 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdtk2_e70f01f5-9263-4184-9615-d3f5c853eab2/global-pull-secret-syncer/0.log" Jun 06 19:38:30.621966 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:30.621936 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-chccm_73e564a6-5fc7-4cd4-8ad9-99f910c55150/konnectivity-agent/0.log" Jun 06 19:38:30.728934 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:30.728903 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-40.ec2.internal_be03cedf9326b812a91e6421c88187cd/haproxy/0.log" Jun 06 19:38:35.391379 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:35.391349 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8pcmh_c26ee03f-cd83-4cb1-bac5-934a823b8396/limitador/0.log" Jun 06 19:38:35.478473 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:35.478441 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f9nw2_d6afabeb-d62c-4485-8465-4bc65c8f09d0/manager/0.log" Jun 06 19:38:37.518551 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.518516 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gjgqk_20ee0f30-8b42-4d22-ac81-a3b8532b128b/kube-state-metrics/0.log" Jun 06 19:38:37.538935 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.538803 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gjgqk_20ee0f30-8b42-4d22-ac81-a3b8532b128b/kube-rbac-proxy-main/0.log" Jun 06 19:38:37.560582 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.560501 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gjgqk_20ee0f30-8b42-4d22-ac81-a3b8532b128b/kube-rbac-proxy-self/0.log" Jun 06 19:38:37.731027 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.730993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5gqs_d27c5c12-280e-4667-8f14-a4c2a4c08536/node-exporter/0.log" Jun 06 19:38:37.756686 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.756655 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5gqs_d27c5c12-280e-4667-8f14-a4c2a4c08536/kube-rbac-proxy/0.log" Jun 06 19:38:37.785019 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.784989 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5gqs_d27c5c12-280e-4667-8f14-a4c2a4c08536/init-textfile/0.log" Jun 06 19:38:37.988987 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:37.988900 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/prometheus/0.log" Jun 06 19:38:38.013748 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.013626 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/config-reloader/0.log" Jun 06 19:38:38.037037 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.036935 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/thanos-sidecar/0.log" Jun 06 19:38:38.059669 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.059640 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/kube-rbac-proxy-web/0.log" Jun 06 19:38:38.083032 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.082993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/kube-rbac-proxy/0.log" Jun 06 19:38:38.106898 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.106867 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/kube-rbac-proxy-thanos/0.log" Jun 06 19:38:38.129640 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.129603 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ef161bbf-7acd-417e-8aff-c1fc427ad034/init-config-reloader/0.log" Jun 06 19:38:38.161379 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.161334 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d9lm2_9bb1d88b-2394-4008-820b-37c91501a02c/prometheus-operator/0.log" Jun 06 19:38:38.181119 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.181087 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-d9lm2_9bb1d88b-2394-4008-820b-37c91501a02c/kube-rbac-proxy/0.log" Jun 06 19:38:38.207311 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.207281 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-rm6p9_26e93b3a-fa29-4aa4-86f5-584436238a4a/prometheus-operator-admission-webhook/0.log" Jun 06 19:38:38.330192 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.330068 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/thanos-query/0.log" Jun 06 19:38:38.354689 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.354608 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/kube-rbac-proxy-web/0.log" Jun 06 19:38:38.375819 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.375769 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/kube-rbac-proxy/0.log" Jun 06 19:38:38.397311 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.397279 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/prom-label-proxy/0.log" Jun 06 19:38:38.419584 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.419520 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/kube-rbac-proxy-rules/0.log" Jun 06 19:38:38.441426 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:38.441393 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd8cf475b-xjbtx_f06d5779-9d49-41d0-99e4-9579fe16cf59/kube-rbac-proxy-metrics/0.log" Jun 06 19:38:40.184414 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:40.184360 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-895zv_7e75363e-d603-4e5d-952a-8cdc70f71a18/networking-console-plugin/0.log" Jun 06 19:38:41.480884 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:41.480850 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75dbcd5458-kzv59_12dd940d-9651-4730-b5ec-57b81c988651/console/0.log" Jun 06 19:38:41.944392 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:41.944308 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:38:41.957504 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:41.957475 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:38:42.317454 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:42.317421 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-4d5nq_24c4b8bd-9844-4143-9b36-fee2d960e314/volume-data-source-validator/0.log" Jun 06 19:38:43.308872 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.308825 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j"] Jun 06 19:38:43.315536 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.315504 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.323037 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.323010 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j"] Jun 06 19:38:43.367494 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.367440 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-sys\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.367801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.367545 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntxmj\" (UniqueName: \"kubernetes.io/projected/cffeeca6-eb34-4412-858f-063969be826d-kube-api-access-ntxmj\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.367801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.367603 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-lib-modules\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.367801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.367663 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-proc\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.367801 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.367706 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-podres\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468463 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468427 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-podres\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468666 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468542 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-sys\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468666 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468602 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntxmj\" (UniqueName: \"kubernetes.io/projected/cffeeca6-eb34-4412-858f-063969be826d-kube-api-access-ntxmj\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468666 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468627 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-podres\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468666 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468629 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-lib-modules\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468893 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468711 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-proc\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468893 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468738 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-lib-modules\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468893 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468795 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-proc\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.468893 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.468796 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cffeeca6-eb34-4412-858f-063969be826d-sys\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.477531 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.477492 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntxmj\" (UniqueName: \"kubernetes.io/projected/cffeeca6-eb34-4412-858f-063969be826d-kube-api-access-ntxmj\") pod \"perf-node-gather-daemonset-w477j\" (UID: \"cffeeca6-eb34-4412-858f-063969be826d\") " pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.593183 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.593113 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ktxws_52bf4dee-5e9a-4856-8755-988585d65388/dns/0.log" Jun 06 19:38:43.614173 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.614145 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ktxws_52bf4dee-5e9a-4856-8755-988585d65388/kube-rbac-proxy/0.log" Jun 06 19:38:43.628842 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.628815 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:43.688711 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.688675 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wlv8_666e7b91-e223-443f-97b7-ef94cba8be98/dns-node-resolver/0.log" Jun 06 19:38:43.783183 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.783025 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j"] Jun 06 19:38:43.787158 ip-10-0-130-40 kubenswrapper[2548]: W0606 19:38:43.785763 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcffeeca6_eb34_4412_858f_063969be826d.slice/crio-f65091449ef6418baa55ded0ba5cadbac20894be238529ee5ae75dae9510aa0a WatchSource:0}: Error finding container f65091449ef6418baa55ded0ba5cadbac20894be238529ee5ae75dae9510aa0a: Status 404 returned error can't find the container with id f65091449ef6418baa55ded0ba5cadbac20894be238529ee5ae75dae9510aa0a Jun 06 19:38:43.806967 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:43.806822 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" event={"ID":"cffeeca6-eb34-4412-858f-063969be826d","Type":"ContainerStarted","Data":"f65091449ef6418baa55ded0ba5cadbac20894be238529ee5ae75dae9510aa0a"} Jun 06 19:38:44.323530 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:44.323498 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wp28k_a03bc987-8ca6-4420-a52c-ece2d922af65/node-ca/0.log" Jun 06 19:38:44.817803 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:44.817768 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" event={"ID":"cffeeca6-eb34-4412-858f-063969be826d","Type":"ContainerStarted","Data":"b478553c3ec78763757f4653ebbd0e6929001e07bc1dc6136f0ee415f573e37a"} Jun 06 19:38:44.817992 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:44.817857 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:44.840579 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:44.839046 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" podStartSLOduration=1.839025132 podStartE2EDuration="1.839025132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 19:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 19:38:44.833767672 +0000 UTC m=+2403.623159456" watchObservedRunningTime="2026-06-06 19:38:44.839025132 +0000 UTC m=+2403.628416918" Jun 06 19:38:45.434105 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:45.434049 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb99459d8-5xf8w_eb1d21b6-f018-4338-9752-1a9207084fef/kube-auth-proxy/0.log" Jun 06 19:38:45.642699 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:45.642665 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h77z4_6202204a-ef56-4c5c-84d4-79b9a7636ccd/payload-processing/0.log" Jun 06 19:38:46.330319 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.330282 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgjl7_c9a88ecd-f049-4ee9-97e4-3bd47283aa52/serve-healthcheck-canary/0.log" Jun 06 19:38:46.862397 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.862361 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nbblc_cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6/insights-operator/0.log" Jun 06 19:38:46.863041 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.863021 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nbblc_cb3d215b-8d5a-4ec2-a7bb-5c5064dabaa6/insights-operator/1.log" Jun 06 19:38:46.889929 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.889904 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7swpc_10b78376-dc98-4466-93d0-41f697975388/kube-rbac-proxy/0.log" Jun 06 19:38:46.911756 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.911733 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7swpc_10b78376-dc98-4466-93d0-41f697975388/exporter/0.log" Jun 06 19:38:46.935748 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:46.935715 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7swpc_10b78376-dc98-4466-93d0-41f697975388/extractor/0.log" Jun 06 19:38:49.488017 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:49.487984 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679555-v8fp5_9c9bd0ed-0a2d-417a-98d2-27e19371c43d/cleanup/0.log" Jun 06 19:38:49.510903 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:49.510875 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679570-pz4qt_fd6699ee-7450-48bd-9379-9402ffe1fa84/cleanup/0.log" Jun 06 19:38:49.971642 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:49.971621 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4_db389929-43ee-4913-ae7d-f0806c85a7e1/manager/0.log" Jun 06 19:38:49.991401 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:49.991376 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4bcfb6f9-rt6v4_db389929-43ee-4913-ae7d-f0806c85a7e1/copy-manifests/0.log" Jun 06 19:38:50.834080 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:50.834050 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ss2g/perf-node-gather-daemonset-w477j" Jun 06 19:38:51.502306 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:51.502280 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c5cb4f5cb-z5vd7_06981f0c-ea08-463f-a376-6ff1ffc66c83/manager/0.log" Jun 06 19:38:51.528950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:51.528919 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zwd8p_6d9b544d-c653-4379-b6fe-25ff06fc8a34/openshift-lws-operator/0.log" Jun 06 19:38:56.257628 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:56.257532 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb99459d8-5xf8w_eb1d21b6-f018-4338-9752-1a9207084fef/kube-auth-proxy/0.log" Jun 06 19:38:56.431352 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:56.431320 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h77z4_6202204a-ef56-4c5c-84d4-79b9a7636ccd/payload-processing/0.log" Jun 06 19:38:56.840407 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:56.840376 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wxg6d_b6101196-9b64-4b10-b650-0b369cac8be7/migrator/0.log" Jun 06 19:38:56.862683 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:56.862647 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wxg6d_b6101196-9b64-4b10-b650-0b369cac8be7/graceful-termination/0.log" Jun 06 19:38:57.279673 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:57.279645 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-2qjr6_03214659-182f-4a11-a9bf-3b0d42462df5/kube-storage-version-migrator-operator/1.log" Jun 06 19:38:57.280504 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:57.280478 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-2qjr6_03214659-182f-4a11-a9bf-3b0d42462df5/kube-storage-version-migrator-operator/0.log" Jun 06 19:38:57.703375 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:57.703303 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb99459d8-5xf8w_eb1d21b6-f018-4338-9752-1a9207084fef/kube-auth-proxy/0.log" Jun 06 19:38:57.871817 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:57.871785 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h77z4_6202204a-ef56-4c5c-84d4-79b9a7636ccd/payload-processing/0.log" Jun 06 19:38:58.621435 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.621408 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/kube-multus-additional-cni-plugins/0.log" Jun 06 19:38:58.641950 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.641926 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/egress-router-binary-copy/0.log" Jun 06 19:38:58.662222 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.662201 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/cni-plugins/0.log" Jun 06 19:38:58.686709 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.686682 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/bond-cni-plugin/0.log" Jun 06 19:38:58.707096 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.707067 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/routeoverride-cni/0.log" Jun 06 19:38:58.730649 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.730614 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/whereabouts-cni-bincopy/0.log" Jun 06 19:38:58.751310 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.751287 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppgtq_6f45eb81-42b9-4309-a496-6dc1cdf88b8e/whereabouts-cni/0.log" Jun 06 19:38:58.977312 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:58.977277 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fqbwn_1ecd4c71-7629-4ba8-a670-2c34196f3277/kube-multus/0.log" Jun 06 19:38:59.029599 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:59.029568 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dmrz_7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0/network-metrics-daemon/0.log" Jun 06 19:38:59.049322 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:59.049288 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dmrz_7a9f978d-d65f-4f92-ac1d-9ca2ef5c5fb0/kube-rbac-proxy/0.log" Jun 06 19:38:59.517538 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:59.517513 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fb99459d8-5xf8w_eb1d21b6-f018-4338-9752-1a9207084fef/kube-auth-proxy/0.log" Jun 06 19:38:59.682208 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:38:59.682157 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h77z4_6202204a-ef56-4c5c-84d4-79b9a7636ccd/payload-processing/0.log" Jun 06 19:39:00.145853 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.145793 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-controller/0.log" Jun 06 19:39:00.164353 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.164315 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/1.log" Jun 06 19:39:00.164938 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.164913 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovn-acl-logging/0.log" Jun 06 19:39:00.186786 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.186759 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/kube-rbac-proxy-node/0.log" Jun 06 19:39:00.210426 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.210351 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/kube-rbac-proxy-ovn-metrics/0.log" Jun 06 19:39:00.230373 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.230338 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/northd/0.log" Jun 06 19:39:00.251421 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.251380 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/nbdb/0.log" Jun 06 19:39:00.272133 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.272107 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/sbdb/0.log" Jun 06 19:39:00.320676 ip-10-0-130-40 kubenswrapper[2548]: I0606 19:39:00.320645 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-245w2_02d13a65-10eb-4c32-8632-1975a236cf38/ovnkube-controller/0.log"